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ABSTRACT 


This  dissertation  considers  optimization  problems  in  which  similar  decisions  need  to 
be  made  repeatedly  over  many  successive  time  periods.  These  problems  have  wide 
applications  including  manpower  planning,  seheduling,  production  planning  and  control, 
capacity  expansion,  and  equipment  replacement/modernization.  In  reality  these  decision 
problems  usually  extend  over  an  indeterminate  time  horizon,  but  it  is  common  practice  to 
model  them  using  a  finite  horizon.  Unfortunately,  an  artificial  finite  horizon  may  adversely 
influence  optimal  decisions,  a  difficulty  commonly  referred  to  as  the  end  effects  problem. 
Past  research  into  end  effects  has  focused  on  theoretical  issues  associated  with  solving  (or 
approximately  solving)  infinite-horizon  extensions  of  finite-horizon  problems.This 
dissertation  derives  equivalent  finite-horizon  formulations  for  a  small  class  of  infinite- 
horizon  problem  structures.  For  a  larger  class  of  linear  and  integer  programs,  it  also 
develops  finite-horizon  approximations  which  bound  the  infinite-horizon  optimal  solution, 
thereby  quantifying  the  influence  of  end  effects.  For  linear  programs,  extensions  of  these 
approximations  quantify  the  end  effects  of  fixed  initial  period  decisions  over  a  functional 
range  of  future  infinite-horizon  conditions.  The  bounding  methods  prove  successful  in 
eliminating  many  end  effects  in  two  sample  applications:  A  linear  program  in  use  by  the 
United  States  Army  for  manpower  planning  and  an  integer  program  in  use  by  the  Defense 
Language  Institute  for  course  scheduling.  Using  as  little  as  two  times  the  computational 
requirements  needed  to  solve  a  finite-horizon  problem,  the  bounding  methods  supply 
feasible  solutions  to  the  infinite-horizon  problems  that  are  guaranteed  to  be  within  1%  of 


optimal. 
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I.  INTRODUCTION 


This  dissertation  considers  optimization  problems  in  which  similar  decisions  need 
to  be  made  repeatedly  over  many  successive  time  periods.  These  problems  have  wide  ap¬ 
plications  including  manpower  planning,  scheduling,  production  planning  and  control,  ca¬ 
pacity  expansion,  and  equipment  replacement/modernization.  Even  though  many  instances 
of  these  decision  problems  extend  over  an  indeterminate  time  horizon,  it  is  common  prac¬ 
tice  to  model  them  using  a  finite  horizon.  The  length  of  the  finite  horizon  (referred  to  as  a 
forecast  or  solution  horizon),  is  usually  subjective  and  driven  by  problem  complexity  and/ 
or  knowledge  of  data  and  functional  structures.  Unfortunately,  in  many  cases,  using  an  ar¬ 
tificial  finite  horizon  adversely  influences  the  optimal  decisions:  This  is  commonly  referred 
to  as  the  end  effects  problem  (Grinold  1983b). 

Past  research  into  end  effects  has  focused  on  solving  (or  approximately  solving)  an 
infinite-horizon  extension  of  the  finite-horizon  problem  and  developing  sufficient  condi¬ 
tions  to  ensure  that  solutions  are  convergent  to  the  infinite  optimal.  If  the  extension  to  the 
infinite  horizon  accurately  reflects  the  true  problem,  generated  solutions  are  optimal  (if  the 
infinite-horizon  problem  can  be  solved  directly),  or  near  optimal  (if  approximation  meth¬ 
ods  are  used)  and  are  not  influenced  by  end  effects.  This  dissertation  derives  equivalent  fi¬ 
nite-horizon  formulations  for  a  small  class  of  infinite-horizon  problem  structures.  For  a 
larger  class  of  linear  and  integer  programs,  it  also  develops  finite-horizon  approximations 
which  bound  any  infinite-horizon  linear  or  integer  program’s  optimal  solution,  thereby 
quantifying  the  influence  of  end  effects.  For  linear  programs,  extensions  of  these  methods 
quantify  the  end  effects  of  fixing  initial  period  decisions  over  a  functional  range  of  future 
infinite-horizon  conditions.  The  bounding  methods  prove  successful  in  eliminating  many 
end  effects  in  two  sample  applications:  A  linear  program  in  use  by  the  United  States  Army 
for  manpower  planning  and  an  integer  program  in  use  by  the  Defense  Language  Institute 
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for  course  scheduling.  Using  as  little  as  two  times  the  computational  requirements  needed 
to  solve  a  finite-horizon  problem,  the  bounding  methods  supply  feasible  solutions  to  the  in- 
finite-horizon  problems  that  are  guaranteed  to  be  within  1%  of  optimal. 

Little  has  been  done  specifically  to  isolate  or  quantify  the  impact  of  end  effects  (ex¬ 
ceptions  being  Grinold  (1983b),  Svoronos  (1985),  and  Schochetman  and  Smith 
( 1 989, 1 99 1 , 1 992)).  Also,  only  a  few  examples  of  infinite-horizon  problem  structures  exist 
for  which  the  form  of  the  infinite-horizon  optimal  solution  is  known,  thereby  eliminating 
end  effects  (see  Grinold  and  Hopkins  (1973a)  and  Schochetman  and  Smith( 1989, 1991, 
1992)  for  published  examples).  No  research  has  been  conducted  to  quantify  end  effects  for 
finite-horizon  formulations  whose  future  period  coefficient  structures  may  vary.  This  re¬ 
search  brings  into  focus  two  general  approximation  methodologies  and  concentrates  on 
identification  of  quantifiable  measures  of  stability  (i.e.,  minimizing  potential  end  effects) 
for  initial  decision  variable(s),  given  some  functional  range  of  future  infinite-horizon  con¬ 
ditions.  This  dissertation  is  organized  as  follows: 


•The  remaining  sections  of  this  chapter  introduce  infinite-horizon  mathemati¬ 
cal  programs,  illustrating  that  strong  and  weak  duality  conditions  are  not 
always  satisfied.  The  chapter  concludes  by  highlighting  the  research  contri¬ 
butions  of  this  dissertation. 

•Chapter  II  provides  a  detailed  review  of  the  separate  literatures  that  exist  for 
infinite-horizon  linear/convex  programs  (see  Manne  (1970),  (1976), 
Grinold(1977),  (1983a/b),  Svoronos(1985))  and  for  finite/bounded  i.e.,  inte¬ 
ger  programs  (see  Bean  and  Smith  (1984),  Schochetman  and  Smith(1989), 
(1991),  (1992)).  The  methodologies  developed  by  this  dissertation  use  as 
their  basis  the  general  solution  techniques  developed  by  Manne,  Grinold,  and 
Svoronos.  Two  illustrative  examples  highlight  the  two  approximation  meth¬ 
ods  used  extensively  in  this  dissertation,  primal  and  dual  equilibrium  approx¬ 
imation  and  their  ability  to  bound  the  infinite-horizon  optimal  objective 
function  value.  The  second  general  approach  is  research  conducted  by  Bean 
and  Smith  (1984),  (1985),  (1993)  and  Schochetman  and  Smith  (1989,  1991, 
1992).  Their  research  involves  developing  methods  to  generate  initial  period 
optimal  solutions  for  infinite-horizon  bounded  integer  programs.  The  authors 
devise  sufficient  conditions  under  which  solving  a  finite-horizon  formulation 
over  a  long  enough  horizon,  generates  an  initial  solution  that  is  optimal  (or 
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near  optimal)  over  the  infinite-horizon.  The  chapter  concludes  each  section 
by  discussing  the  applicability  of  each  method  to  the  end  effects  problem. 

•Chapter  III  derives  several  simple  single  period  overlap  staircase  structures 
that  have  infinite  optimal  solutions  which  satisfy  the  dual  equilibrium  condi¬ 
tions  defined  by  Grinold  (1983b).  Since  the  solution  form  of  the  infinite-hori¬ 
zon  optimal  is  known,  end  effects  are  eliminated  using  dual  equilibrium 
approximation. 

•Chapter  IV  lays  the  basic  theoretical  background  to  support  the  use  of  primal 
and  dual  equilibrium  approximations  to  quantify  end  effects  associated  with 
infinite-horizon  linear  and  integer  programs.  Proofs  are  provided  showing 
primal  and  dual  equilibrium  approximations  have  monotonic  optimal  objec¬ 
tive  values  over  an  increasing  solution  horizon.  An  example  illustrates  that 
convergence  of  dual  and  truncation  approximation  methods  is  possible,  even 
when  weak  and  strong  duality  fail. 

•Chapter  V  develops  the  theory  and  a  set  of  algorithms  that  quantify  the 
impact  of  a  changing  right  hand  side  on  the  initial  period  optimal  solutions 
for  infinite-horizon  linear  programs. 

•Chapter  VI  applies  the  primal  and  dual  equilibrium  approximations  to  a  real- 
world  linear  program  (a  military  manpower  planning  model  in  use  by  the 
United  States  Army).  The  chapter  presents  the  model,  its  extension  over  an 
infinite-horizon,  application  of  primal  and  dual  equilibrium  approximations, 
and  an  extensive  computational  study.  The  computational  study  includes  the 
impact  of  future  period  growth  on  initial  decisions  made  under  assumptions 
of  zero  growth. 

•Chapter  VII  applies  primal  and  dual  approximations,  which  were  originally 
developed  for  use  with  linear  and  convex  programs,  to  a  real-world  integer 
program  in  use  by  the  Defense  Language  Institute  as  a  decision  aid  to  deter¬ 
mine  instructor  requirements  and  establish  course  schedules. 

•Chapter  VIII  summarizes  the  key  theoretical  results  and  insights  gained  from 
implementation  on  the  two  real-world  problems,  and  also  provides  recom¬ 
mendations  for  future  research. 
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A.  THEORETICAL  RESULTS 


The  main  theoretical  results  of  this  dissertation  are: 

•Showing  a  class  of  infinite-horizon  problem  structures  have  equivalent  finite- 
horizon  formulations.  These  problems  can  easily  be  solved  providing  optimal 
solutions  free  of  end  effects. 

•Showing  that  primal  and  dual  equilibrium  approximations,  which  were  origi¬ 
nally  developed  for  infinite-horizon  linear  and  convex  programs,  can  also  be 
applied  to  integer  programs. 

•Showing  that  convergence  of  the  truncation  and  dual  equilibrium  formula¬ 
tions  to  an  infinite  optimal  solution  can  be  achieved  even  if  strong  and  weak 
duality  fail  in  the  limit. 

•Deriving  an  algorithm  that  provides  a  method  of  bounding  the  potential  error 
associated  with  using  initial  decision  variables  generated  under  certain 
assumed  conditions,  when  those  conditions  vary  over  a  functional  range  of 
values. 

B.  PRACTICAL  RESULTS 

The  practical  implications  of  this  research  include: 

•Validating  the  effectiveness  of  using  primal  and  dual  equilibrium  approxima¬ 
tions  to  bound  the  infinite-horizon  optimal  solution  and  quantify  end  effects 
for  a  real-world  military  manpower  planning  model.  Little  research  has  been 
conducted  in  the  last  ten  years  in  the  use  of  either  primal  or  dual  equilibrium 
approximations.  Only  Svoronos  (1985),  in  his  unpublished  dissertation,  has 
used  both  methods  together  to  bound  the  infinite-horizon  optimal  solution. 
However,  for  the  manpower  planning  model  examined,  the  primal  and  dual 
equilibrium  approximation  methods  prove  highly  successful  in  identifying 
and  quantifying  end  effects  associated  with  solving  the  model  over  a  finite 
solution  horizon. 

•Validating  the  algorithm  developed  in  this  dissertation  to  bound  the  potential 
error  when  using  specific  values  of  decision  variables  over  a  functional  range 
of  future  conditions. 

•Validating  the  effectiveness  of  using  primal  and  dual  equilibrium  approxima¬ 
tion  methods  to  bound  the  optimal  infinite-horizon  objective  function  value 
and  to  quantify  end  effects  associated  with  a  finite-horizon  integer  program. 
No  work  has  been  found  that  uses  primal  and  dual  equilibrium  approxima- 
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tions  to  quantify  end  effects  associated  with  integer  programs.  For  the  integer 
program  examined,  these  methods  prove  highly  successful  in  identifying  and 
quantifying  end  effects  linked  to  the  finite-horizon  formulation. 


C.  INFINITE-HORIZON  MATHEMATICAL  PROGRAMS 

This  dissertation  considers  a  (countably)  infinite-horizon  integer  or  linear  program 
MPcc:  ■ 


Minimize  ^  (x^) 

t  =  o 


Subject  to: 

^  (0,  0)  ^^0^ 

=  ^0 

^  (1, 0)  ^^0^  ^  {1, 1) 

=  b^ 

^  (2, 0)  ^^0^  ^  (2, 1)  ^  (2, 2)  (-*^2) 

~  *2 

^(3,0)  ^^0)  ^(5,/)  ^(5,2)  (^2)  ••• 

^  {T,0)  ^^0^  ^  {T,  1)  ^  {T,2)  ^^2^ 

A  j.)  (Xj.) 

=  bj 

0<x^<Uf  (t=0,l,2,...) . 

Where: 

•  Up  Cp,  and  bf  are  data  vectors  of  dimensions  1 ,  1  xn,,  and  m,x  1 ,  t^. 
(It  is  possible  that  the  dimensionality  may  vary  by  period).  In  addition,  we 
can  assign,  npn,  mpm,  for  t>l. 

•  a  is  a  discount  factor  such  that  (0<a<i).  The  restriction  CL<1  is  needed  to 
ensure  convergence  of  the  objective  function. 

•Xf  is  a  decision  vector  of  dimension  n,xl ,  where  x,  g  Z, .  c  i?  '  or 

e  Z"'  depending  on  whether  the  problem  of  interest  is  a  linear  or  integer 
infinite-horizon  program. 

•Cp{xp)  (t>0)  is  a  linear  function  from  x^e  X,  R,  that  is  bounded  above 
by  an  exponential  growth  function. 
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nif 

•  A  (,  <■)  (jc,.)  (t>0,t<  t')  ,  is  a  linear  function  from  XfG  ->  /(  . 

The  ideal  situation  would  be  to  solve  the  above  problem  directly,  effectively  dealing 
with  end  effects.  However; 

•Accurate  projections  of  future  data  may  be  difficult  if  not  impossible  to 
obtain. 

•Even  if  accurate  projections  are  available,  many  infinite-horizon  mathemati¬ 
cal  programs  cannot  be  solved  directly. 

D.  STRONG  AND  WEAK  DUALITY  OVER  AN  INFINITE- 
HORIZON 

Any  consistent  finite  dimensional  convex  mathematical  program  satisfies  strong 
and  weak  duality  (Bazaraa  and  Shetty  (1979)).  However,  when  extended  over  an  infinite- 
horizon,  strong  and  weak  duality  do  not  necessarily  hold.  The  following  examples  illustrate 
the  concepts  of  duality  gap  (failure  of  strong  duality  in  the  limit)  and  duality  overlap  (fail¬ 
ure  of  strong  and  weak  duality  in  the  limit). 

1.  Duality  Gap 

The  following  example,  modified  from  Duffin  and  Karlovitz  (1965),  illustrates  the 
violation  of  strong  duality  {i.e.,  existence  of  a  duality  gap).  The  primal  formulation  is: 
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Minimize 

^1 

Subject  to 

^1 

>-l 

1 

4^1+ 

1 

>0 

1 

5^7+ 

1 

>0 

1 

-X.+ 

n  ‘ 

1 

-2^2 

n 

>0 

Xj  e  R,  JC2  e  R. 


The  associated  dual  formulation: 

Maximize  -  +  OU2  +  +  ...  +  Ou^  +  . . . 

Subject  to: 


0«;+  ^«2  + 


Uj>0 


+ - 

«+2  ” 


(n  +  2) 


2“/*+ 


«„>0 


For  any  finite-horizon  problem  (i.e.,  fix  n),  strong  and  weak  duality  hold  for  the  pri¬ 
mal  and  dual  pair  with  optimal  objective  function  values  equal  to  -1  {xj=-l  and  A:j=n,  Uj=l 

and  Ut=0  {2<t^)).  As  n  ->  <»,  the  dual  formulation  maintains  the  optimal  objective  val¬ 
ue  of  -1  with  optimal  dual  decision  variables  a;=/,  Uf=0  (t>2).  However,  the  infimum  of 
the  primal  formulation  is  zero  with  xj=X2=0,  as  ac;  is  driven  to  zero  to  keep  X2  finite.  This 
is  a  pathological  example,  since  the  added  constraint  X2‘^,  for  large  M,  allows  strong  and 
weak  duality  to  hold  in  the  limit. 
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2.  Duality  Overlap 

This  example,  provided  by  Grinold  and  Hopkins  (1973b),  is  a  linear  program  that, 
when  expanded  over  an  infinite-horizon,  exhibits  a  duality  overlap. 

The  primal  formulation  is: 


Maximize  Uq  +  Vq 
Subject  to: 

u^-2v^_^j<0fort=0,l,2,...n-l  (1) 
v^-2u^_^j<0  fort=0,l,2,...n-l  (2) 

(3) 

<  0  (4) 

fort=0,l,2,...n. 

For  any  horizon,  an  optimal  primal  solution  with  objective  function  value  of  zero, 
is  jP  _2f^  z-o  (t=0,l,2,...n).  For  any  finite  n,  dual  constraints  (3)  and  (4)  result  as  special 
cases  of  constraints  (1)  and  (2)  when  t—n,  (i.e.,  v„+7  and  do  not  exist  for  any  finite 
formulation).  For  finite  n,  the  optimal  dual  solution  with  objective  function  value  of  zero, 
is  v,=M,=0  (for  all  0<t^).  However,  in  the  limit  as  n  ^  «>,  the  dual  formulation  no  long¬ 
er  includes  constraints  (3)  and  (4)  and  =  V,  =  ^2^  (for  all  t=0,i, 2, 5,...)  is  feasible 
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with  an  objective  function  value  of  2.  Therefore,  in  the  limit,  a  duality  overlap  of  2  exists 
between  the  primal  and  dual  formulations’  optimal  objective  function  values. 

E.  SUMMARY 

For  both  the  special  cases  presented  in  the  last  section,  strong  and/or  weak  duality 
fail  in  the  limit  (as  n  -4  «>).  As  illustrated  in  later  sections,  while  this  is  an  interesting 
theoretical  problem,  the  bounding  techniques  developed  to  eliminate  and/or  quantify  end 
effects  work  even  when  strong  or  weak  duality  are  not  satisfied  in  the  limit. 

The  next  chapter  provides  a  detailed  review  of  the  separate  literatures  that  exist  for 
infinite  horizon  linear/convex  programs  and  for  finite/bounded  programs. 


11.  BACKGROUND 


This  chapter  provides  a  detailed  review  of  the  separate  literatures  that  exist  for  in- 
finite-horizon  linear/convex  programs  (Manne  (1970),  (1976),  Grinold(1977),  (1983a/b), 
Svoron6s(1985)),  and  for  finite/bounded  programs  (Bean  and  Smith  (1984),  Schochetman 
and  Smith(1989),  (1991),  (1992)).  The  focus  of  this  review  is  the  applicability  of  these 
techniques  to  cope  with  end  effects. 

Section  A  provides  a  review  of  five  approximation  methodologies  developed  for  in- 
finite-horizon  linear  programs  {Truncation,  Salvage,  Fixed  End  Conditions,  Primal  Equi¬ 
librium,  and  Dual  Equilibrium) illustrative  examples  highlight  some  of  the  properties 
associated  with  the  primal  and  dual  equilibrium  approximations. 

Second  B  extends  the  concept  of  using  primal  and  dual  equilibrium  approximations 
to  bound  the  infinite  optimal  solution  for  infinite-horizon  convex  programs  (Svoronos, 
1985).  A  simple  example  illustrates  the  effectiveness  of  the  bounding  methodology  pro¬ 
posed  by  Svoronos  and  developed  independently  by  the  author. 

Section  C  reviews  research  conducted  by  Bean  and  Smith  (1984),  (1985),  (1993) 
and  Schochetman  and  Smith  (1989),  (1991),  (1992).  Their  research  involves  developing 
methods  to  generate  initial  period  optimal  solutions  for  infinite-horizon  bounded  integer 
programs.  The  authors  devise  sufficient  conditions  for  which  solving  a  truncated  formula¬ 
tion  over  a  long  enough  horizon,  generates  an  initial  solution  that  is  optimal  (or  near  opti¬ 
mal)  over  the  infinite  horizon. 

The  last  section  of  this  chapter  concludes  that  together  primal  and  dual  equilibrium 
approximations  show  the  greatest  promise  for  practical  implementation.  Follow  on  chap¬ 
ters  expand  on  issues  associated  with  practical  implementation  of  primal  and  dual  equilib¬ 
rium  approximations  to  quantify  end  effects  for  both  infinite-horizon  linear  and  integer 
programs. 
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A.  INFINITE  HORIZON  LINEAR  PROGRAMMING  AND  END 
EFFECTS 

When  Xf  is  a  real  valued  vector,  (i.e.,  a  member  of  r"'  ),  the  infinite-horizon  math¬ 
ematical  program  is  an  infinite-horizon  linear  program  (hereto  defined  as  LP°° ).  Research 
into  solving  and  understanding  the  underlying  structures  of  LPoo  has  been  conducted  by 
Manne  (1970,1976),  Hopkins  (1971),  Grinold  and  Hopkins  (1973a),  Grinold  (1971, 1977, 
1983a/b),  Murphy  and  Soyster  (1986),  and  Romeijn,  Smith,  and  Bean  (1992).  The  purpose 
of  this  chapter  is  to  summarize  the  results  of  past  research  in  this  area  and  highlight  the  ap¬ 
plicability  of  such  work  to  end  effects  when  the  original  problem  can  be  formulated  as  a 

LPoo. 


1.  Approximation  Methods 

Grinold  (1983b)  identifies  five  general  approximation  techniques  (Truncation,  Sal¬ 
vage,  Fixed  End  Conditions,  Primal  Equilibrium,  and  Dual  Equilibrium),  that  can  generate 

finite-horizon  approximations  for  LPoo . 

a.  Truncation 

Truncation  approximates  the  LPoo  by  dropping  constraints  and  cost  coeffi¬ 
cients  tied  to  the  variables  {t^T+1).  The  following  is  a  truncation  approximation  of  LP^: 
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T 

Minimize  ^ 
t  =  o 


Subject  to: 

^(0,0)^0 

IV 

(0) 

>bi 

U) 

^{2,1)^!'^  ^(2, 2)^2 

>b2 

(2) 

^{3, 0)^0'^  (3, 1)^1'^  ^(3,  2)^2'^  ^(3, 3)^ 3 

(3) 

^{T,2)^2'^  ^{T,3)^3'^  •• 

■  ^  T)  ^  T  ^  I' 

(T) 

0<X^<U^ 

(t=0,l,2,...). 

Truncation  disconnects  the  first  T  period  decisions  from  the  rest  of  the  prob- 

lem.  The  form  of  disconnection  assumes  that  resources  created  up  to  time  T  have  no  value 
after  period  T.  This  can  lead  to  end  effects  where  either  the  initial  decision  variable(s)  are 
suboptimal,  or  worse,  infeasible  over  LPoo .  Truncation  is  effective  at  eliminating  end  ef¬ 
fects  over  the  initial  decision(s)  jcq,  when  there  exists  an  F  such  that  for  all  {T>F),  the  opti¬ 
mal  initial  decision  variable(s)  for  the  T  period  truncation,  x/  are  optimal  for  LPoo .  The 
difficulty  lies  in  determining  under  what  conditions  one  can  guarantee  that  a  finite  F  exists. 
Assuming  sufficient  conditions  exist  for  weak  and  strong  duality  for  a  LP°°  {i.e. ,  Romeijn, 
Smith,  and  Bean  (1992)),  the  cluster  points  (as  T  -»  oo )  of  the  sequence  {x/}  form  a  set 
of  optimal  points  for  LPo° .  However  (as  subsequently  shown  in  section  A.2),  there  is  no 
assurance  in  general  of  the  existence  of  a  finite  forecast  horizon  F,  such  that  if  ,  and  the 

truncation  problem  is  solved,  the  resulting  Xq^  is  optimal  to  LPoo . 

The  truncation  method  has  the  property  that  given  for  all  t>T,  the  opti¬ 
mal  objective  function  value  to  the  tmncated  problem  is  a  lower  bound  to  the  optimal  ob¬ 
jective  function  value  of  LPoo . 
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b.  Salvage 

The  salvage  technique  extends  truncation  by  placing  a  future  value  on  re¬ 
sources  carried  over  into  later  periods  {salvage  value).  The  model  formulation  is  very  sim¬ 
ilar  to  truncation  except  the  objective  includes  salvage  values  that  represent  the  per  unit 
value  of  in  all  future  periods  not  explicitly  modeled  (Le.,  periods  T+1,  T+2,  T+3,...). 

T 

Minimize  '^(X  (c^  -  d^) 

t  =  0 


Subject 

to: 

^0^0 

II 

0 

(0) 

HjXo 

=  *7 

(1) 

^2^0 

+KiXi 

+AX2 

II 

(2) 

^3^0 

+K2XJ 

+K1X2 

+AXj 

II 

(3) 

HfXo 

+Kj,_jXj 

+ Kj.  _  2^2 

.  .  . 

4*AXj.  —  b  rp 

(T) 

0<x^<upf  (t=0,l,2,...,T) . 

Grinold  (1983b)  uses  Lagrange  multipliers  to  relate  the  infinite-horizon  and 
salvage  linear  program  formulations.  Grinold  starts  with  the  LPo°  problem: 
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Minimize  ^  a 
t  =  o 

Subject  to: 


^0^0 

=  bQ  (0) 

HjXq  +AAr  j 

=  bj  (i) 

H2X0  +KjXj 

+AX2 

=  b2  (2) 

H^Xq  +^2^7 

+KjX2  +AXj 

=  b,  (3) 

HjXq  +Kj,_jXj 

■\-K-p_  2^2 

... 

+Axj,  =  bj.  (T) 

0<Xj<upj  (t=i 

0,1,2,...). 

Grinold  (1983b)  uses  Lagrange  multipliers  a,,  to  formulate  LPo°  as: 

00 

f 

t-i  \ 

Minimize  V  CLc^x^  +  \  a 

bj-HjXQ- 

t  =  o 

t=T+I 

K 

n  =  l  '' 

Subject  to: 

^0^0 

=  bQ  (0) 

HjXq  +AXj 

=bj  (1) 

H2X0  +KjXj 

+AX2 

=  b2  (2) 

H^Xq  +K2XJ 

+KjX2 

+Ax^ 

=  b^  (3) 

H  J^X Q  '\‘Krp  ^  jX  J 

'\~FkjQ_  2^2 

.  . . 

+AXj  =  bj.  (T) 

0<Xf<upf  (t=0,l,2,...). 

Grinold  (1983b)  illustrates  that  if: 

oo 

do=  ^  ^  ’ 

t=T+l 
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d.=  ^  a  (l<j^)  ;and 

t  =  T+l 

oo 

dj  =  UjA  +  ^  o' Uf  (j>T+l) . 

t  =  i 

Then  the  objective  function: 

oo  00/  t  ■—  J  'y 

Minimize  ^ac^x^+  ^  au^  b^-H^XQ-  ^  K^_^Xn-Ax^  can 

t=o  t=T+l  ^  n=l  ' 

be  rewritten  as: 

J’  00  00 

Minimize  {c^-d^)x^+  ^  a  (c^-d^)x^+  ^  aufi^. 

t=0  t=T+l  t=T+J 

The  salvage  technique  uses  the  first  term  and  ignores  the  last  two  terms  of 

the  reformulated  objective  function.  Grinold  (1983b)  further  shows  that 

T'  00  00 

Minimize  a  (c^-d^)  x^  +  ^  a  (c^-d^)  Xf+  ^  yields  a  lower  bound 

t=0  t=T+l  t=T+l 

on  the  optimal  value  of  the  infinite  horizon  problem  provided  the  following  assumptions 
hold: 

•Given  any  set  {U(},df  (for  all  t)  exist; 


•The  sum  X  “  exists;  and 

t-T*l 

•The  optimal  solution  jTj*  t>T+l  of 
Minimize  (c^  -  d^  x^ 
Subject  to: 

0<Xf<up^ 

exists  for  all  t>T+l. 
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A  difficulty  with  using  the  salvage  method  lies  in  determining  a-priori  the 
proper  salvage  values  {rf,}  or  Lagrange  multipliers  {U(].  Grinold  (1983b)  illustrates  that 
under  the  above  assumptions,  given  any  set  of  Lagrange  multipliers  {«t}.  an  optimal  solu¬ 
tion  Xx*)  to  the  salvage  approximation  provides  a  lower  bound  to 

LPoo  (as  defined  in  this  section).  However,  the  quality  of  any  solution  is  dependent  on  the 
a-priori •choice(s)  for  and  {m,}.  Therefore,  it  is  impossible  in  general  to  quantify  the 
end  effects  of  any  derived  optimal  solution  set  using  salvage  techniques.  A  poor  choice  of 
{df]  and  {Mj}  can  lead  to  greater  end  effects  difficulties  than  those  created  by  the  truncated 

solution  approach. 

c.  Fixed  End  Conditions 

Another  typical  approach  to  deal  with  LPoo ,  is  to  solve  a  finite  period  prob¬ 
lem,  fixing  the  desired  end  conditions.  The  formulation  is  very  similar  to  truncation,  how¬ 
ever,  it  includes  one  additional  constraint  (representing  the  tie-in  to  all  future  constraints). 


T 

Minimize  ^  cdc^x^ 

t  =  0 

Subject  to: 

^U,0)^0'^  ^  {1, 1)^1 


^^0 

>b, 


^(T  +  1,  T)^T 


>bj. 

-^T+l~^(T+l,T  +  l)^T+I 

jc .  >  0,  (0<i^) 


Given  a  staircase  problem  structure  and  a-priori  the  infinite  optimal  value  of 
Af^T+i  t+i)^t+j  ’  solving  the  above  formulation  provides  an  infinite  optimal  solution  for  the 
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variables  Xq,  x j,  X2,...  Xj.  Consider  the  following  example: 


00 

Minimize  ^  {0.9)‘x^ 

t  =  0 

Subject  to: 

Xq 

>1 

Xo+  Xj 

>1 

Xj+  X2 

>1 

X2+ 

>1 

x^>0  {t=0,l,2,3...). 

For  this  example  the  optimal  solution  is  Xf=l  (t=0,  2,  4,...),  Xf=0  (t=l,  3, 
5...).  (See  chapter  III  section  A  for  a  proof  that  problems  with  this  structure  have  optimal 
solutions  of  this  form.) 

Using  JCj=0,  the  problem  can  be  formulated  as: 


ily  solved: 


CX3 

Minimize  ^  (0.9)^ x^ 
t  =  o 

Subject  to: 


>1 

>1 

>1 

>l-{x^  =  0) 

>l-{Xj  =  0) 
>1 


Note  that  the  problem  is  separable,  which  allows  for  Xq,Xj,  and X2  to  be  eas¬ 
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'Minimize  {Xq  +  0.9xj  +  0.  81  x 2) 
Subject  to: 


^0 

Xq  +  Xi 


>1 

>1 


Xj+X2'^l 

X2>1 


Xq,Xj,X2>0 


Minimize  ^  {0.9)^ x^ 


t  =  4 


Subject  to: 
x^ 


x^+  x^ 


^5+ 


^6+ 


x^>0 


>1 

>1 

>1 

>1 


Solving  the  finite-horizon  problem  on  the  left  provides  an  optimal  solution  of  Xq=1,  X]=0, 


X2=l. 

Fixing  end  conditions  assumes  that  the  infinite  optimal  solution  has  as  part 
of  its  optimal  solution  set,  .  Of  course,  the  difficulty  lies  in  identifying  an 

optimal  xj^i.  For  linear  programs,  the  number  of  feasible  values  for  Xj+  j  is  in  general  un- 
countably  infinite  (a  special  case  however,  exists  when  only  one  point  arj+y  is  feasible  over 
the  infinite-horizon  problem  space).  While  in  theory  it  is  possible  to  address  this  issue, 
(Schochetman  and  Smith  (1989,  1991,  1992)),  the  approach  in  general  is  plausible  only 
when  there  exists  some  period  T+1  for  which  JCj+7  has  only  a  manageably  finite  number  of 
possible  solutions.  Using  this  method  with  a  suboptimal  end  condition  produces  an  unwant¬ 
ed  end  effect  whose  influence  cannot  be  easily  measured. 
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d.  Primal  Equilibrium  Approximation 

Manne  (1970, 1976)  proposed  an  approximation  to  LPo°  that  assumes  there 
exists  a  time  period  T,  such  that  for  all  t>T,Xi^i='kx^  (i.e.,  the  decision  variables  after  a  fixed 
period  become  functionally  related).  Grinold  (1983b)  refers  to  this  as  Primal  Equilibrium 
approximation.  Svoronos  (1985)  further  expands  this  definition  to  be  any  restriction  on  the 
feasible  region,  such  that  a  finite  period  re-formulation  is  possible.  For  the  purposes  of  il¬ 
lustration,  we  restrict  ourselves  in  this  section  to  restrictions  posed  by  Manne.  The  primal 
equilibrium  approximation  requires  the  following  assumptions: 

•Ct=c<M,  t>T; 

•Xa<l  (Needed  for  objective  function  convergence); 

•There  exists  an  L  such  that  for  all  {Q<t<t’)  (implying  any 

decision  variable  x,  links  only  a  finite  number  of  constraints); 

•There  exists  a  I  such  that  ^)=A,  (where t>T); 

•Aq  is  the  lower  triangular  matrix  structure  associated  with  the  variables  Xq,  Xj, 

X2,...X7’.7  with  dimensions  [{mQ+mj+m2+...+mj.j)  x  (n(j+n;+n2+-+«7’-7)]; 

•H,={A(,o),^(r.7).>l(f,2)’-^a7’-/)}  with  dimensions  [(m,)  x  («(,-i-n;+«2+- 

+W7’-7)] 

(t^T)  (ensuring  non-empty  primal  feasible  region  when  Xt+j='kXf. 
Figure  1  shows  the  general  form  of  LP^o  satisfying  the  above  conditions: 
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oo 


J 

Minimize  cXq  +  a 

t  —  T 

Subject  to: 

t  =  T 

^0^0 

11 

(0) 

HjXq+  Axj 

II 

(1) 

H^Xq^  KjXj+ 

Axt  +  1 

II 

(2) 

^^T  +  2 

=  xhr 

(3) 

HjXq+  Kj^_jXj.-\- 

^L-2^T+ 1'^  ^L-3^T  +  2'^  " 

•  ^^T  +  L-l  “  ^ 

(L) 

KjjXj-+ 

^L-l^T+l'^  ^L-2^T  +  2 

(L+7) 

^L-1^T  +  2 

• 

Figure  1. 

Xf>0  {t=0,T,T+l,.. 

.) 

General  form  of  LP«>  formulation  for  which 
primal  equilibrium  approximation  is  applicable. 


Where  Xg  is  the  aggregated  vector  (xq,  Xj,  X2,  Xs,...Xj.i)  and  c  is  the  vector  (cj,  (XCi,  C?C2, 
o^C3,...,aF'^CT.i),  and  bo  is  the  vector  Qjq,  b j,  b2,  bs-bj-.j),  (with  dimensions 
{n;+n2+»j+-  +»r-i}  x  7 ,  7  x  {nj+n2+n3+...  +nj.j}  and  {m;+»i2+mj+...  +mT.j} 

X  7 ).  When  x^+j  is  restricted  to  Xf+]=XXf  for  f>T,  the  above  structure  allows  an  equiva¬ 
lent  finite  period  formulation.  For  example,  consider  L=7.  The  constraints  from  period  T 
onward  (Le.,  equation  (3)  onward  in  Figure  1)  become  redundant.  Substituting  Xf+]='kXf 

for  t>T,  the  objective  function  can  be  re-written  in  terms  of  Xg  andxf. 


T 

cxq  +  a 


-  T) 

a 


At-T) 

A,  cXj.. 


t=T 

If  L>7  and  A=l,  then  adding  the  functional  constraint  set  Xf^.i^=Xf,  t>T,  k  finite  leads  to  a 
finite  period  reformulation  as  the  constraint  set  again  eventually  becomes  redundant. 
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Primal  equilibrium  approximation  has  the  following  properties.  (The  prop¬ 
erties  are  formally  proven  in  Chapter  IV). 

•Primal  equilibrium  approximation  adds  constraints  (i.e.,  restrictions)  to  the 
original  primal  feasible  region.  Therefore,  any  primal  equilibrium 
approximation  optimal  solution  is  an  upper  bound  to  the  LPo=  optimal 
objective  function  value. 

oo 

•Let  }  be  an  optimal  solution  to  the  primal  equilibrium  approximation 

t  =  0 

where  jc,  These  decision  variables  form  a  feasible  solution 

sequence  to  the  LPoo  problem. 

The  primal  equilibrium  approximation  assumes  a  T  exists  where  a  function¬ 
al  relationship  can  be  derived  that  restricts  the  feasible  region  and  leads  to  a  finite  period 
re-formulation.  If  this  functional  relationship  holds  for  an  optimal  solution  to  LPoo ,  and  T 
is  known,  end  effects  are  eliminated.  The  difficulty  lies  in  determining  a-priori  if  the  prob¬ 
lem  structure  has  an  infinite  optimal  sequence  where  the  functional  relationship  holds. 
Manne  (1970)  derived  a  set  of  sufficient  conditions  under  which  primal  equilibrium  func¬ 
tional  relationships  exist  in  optimal  primal  solution  sequences.  If  an  optimal  solution  does 
not  exist  satisfying  the  functional  relationship,  the  optimal  solutions  to  the  infinite  horizon 
formulation  may  be  severely  impacted.  Even  in  such  circumstances.  Chapter  IV  shows  that 
primal  equilibrium  approximation  provides  an  upper  bound  on  the  optimal  objective  func¬ 
tion  value  to  LP°o.  It  is  important  to  note,  that  even  if  primal  equilibrium  approximation 
converges  to  the  optimal  solution  for  LPoo ,  this  does  not  necessarily  imply  the  existence  of 
a  finite  forecast  horizon  F,  such  that  if  k=F,  and  the  primal  equilibrium  approximation  is 

solved,  the  resulting  is  optimal  to  LP°°  for  any  t  (0<t<F). 

e.  Dual  Equilibrium  Approximation 

Dual  equilibrium  approximation  (see  Grinold  (1971,  1977,  1983a/b)), 
solves  LPoo  by  aggregating  constraints  of  the  original  problem,  in  a  manner  that  allows  re- 
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formulation  of  LPoo  as  a  finite-horizon  linear  program.  Dual  equilibrium  approximation 
provides  solutions  for  LP®®  problems  with  the  following  general  structure; 

oo 

Minimize  cXq  +  a^  ^  (X 
t  =  T 

Subject  to: 


>bo 

(0) 

HjXq+ 

AXj 

IV 

(1) 

H2XQ+ 

Axt^i 

IV 

+ 

(2) 

H3X0+ 

-^T  +  2 

(3) 

+  ••• 

^^T+L-l 

~  ^T+L-1 

(L) 

Axt^l 

~  ^T  +  L 

(L+1) 

0<Xq<Uo 

0<x^<u^  {t=l,2,...) 

The  following  conventions  are  used: 

•  JCo ,  is  the  aggregated  vector  (xq,  x /,  X2,  Xj,  X4,...^j.i),  (with  dimensions 
{nQ+nj+n2-^—+nj_j)  x  l)\ 


•c  is  the  vector  (cq,  ac j,  a?C2,  (with  dimensions 

1 X  (nQ+nj+n2'^--‘+nji])y, 

•Cf=c  for  all  t>T; 

•  bo  is  the  aggregated  right  hand  side  (bg,  bj.  b2.  (with  dimensions 

(tnQ+nij+m2'^---  x  7). 

In  addition,  the  following  functional  relationships  must  hold: 

;)=A  (for  all  t>T),  A  =Kj  (whevcj=t-t\  t>t',t>  T); 

•  Aq  is  the  lower  triangular  matrix  for  variables  Xq,Xj,X2,..-Xj.j  with 
dimensions  [(mo+wi;+/«2+... +/W 7-./)  x  {nQ+ni+n2+...+nj.j)Y, 


23 


A(t,l)’  ^(t,2)’--^(t,T-l)}  with  dimensions  [(/w^)  x 
{{nQ+nj+n2+---+nj_])]  {t^-iy,  and 


•The  infinite  sums  b^=  ^  a”  ,  H^=  ^  a”  , 

n=T  n=l 


A 


a 


oo  oo 

A  +  2  aK^ ,  and  -  “a  ^  ~ 

n=]  n=T 


Aggregating  all  constraints  from  time  T  onward  under  the  condition  that  the  jth  constraint 
(j>l)  multiplied  by  leads  to  the  following  formulation: 

T 

Minimize  cXq  +  a  cx^ 


Dual  equilibrium  has  the  following  properties: 

•The  optimal  value  of  the  dual  equilibrium  relaxation  is  a  lower  bound  on  the 
optimal  value  of  .  Aggregating  the  constraint  space  is  a  relaxation  of  the 
original  feasible  region,  therefore,  the  derived  optimal  solution  cannot  be 
worse,  {i.e.,  the  set  of  feasible  solution  sequences  for  is  a  subset  to  the 
set  of  feasible  solution  sequences  for  the  dual  equilibrium  approximation). 
Chapter  IV  contains  a  proof. 


•Define  xl,  x^  as  optimal  solution  values  to  the  relaxation  where  the 
aggregation  of  constraints  begins  at  period  T.  Note  that 
xl  =  xl,  x],  xl,  xl,  ...xl_i  are  feasible  to  the  first  T-1  constraints  of  LPo° 


•If  the  value  of  the  optimal  objective  function  for  the  dual  equilibrium 
problem  converges  to  the  optimal  objective  function  for  LPoo  then  for  all 

finite  teZ^,  there  exists  a  subsequence  S,  c  ,  such  that  for  keSj 


j.  -^x,*  ,  where  xj^  is  an  optimal  decision  variable  for  a  k  period 
approximation  and  Xf*  is  an  optimal  decision  variable  for  LP<=°  (See 
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Grinold(1977,  1983),  Svoronos  (1985),  and  Romeijn,  Smith,  and  Bean 
(1992)). 

Dual  equilibrium  approximation  aggregates  constraints  from  period  T+1 
onward.  The  effect  of  this  aggregation  becomes  clearer  if  one  looks  at  the  equivalent  for¬ 
mulation  one  can  obtain  using  Lagrange  multipliers.  Given  LP<»,  placing  the  constraints 
from  period  T+1  onward  into  the  objective  function  with  their  associated  multipliers,  and 
assuming  that  the  multipliers  have  the  functional  relationship  that  j=mi^  {t>T+l),  leads 
to  an  objective  function  with  only  one  multiplier  for  the  aggregated  discounted  summation 
of  all  constraints  beyond  T+1.  Dual  equilibrium  approximation,  when  applicable,  indicates 
that  the  value  of  future  resources  is  functionally  tied  and  decreasing  at  a  constant  rate.  If  an 
optimal  solution  to  the  original  infinite  horizon  formulation  has  this  underlying  functional 
relationship,  solving  the  dual  equilibrium  reformulation  with  the  proper  value  of  T  pro¬ 
vides  an  optimal  ato  for  LP^ .  Grinold  and  Hopkins  (1973b)  identify  a  class  of  problems  in 
which  an  infinite  horizon  optimal  has  the  dual  equilibrium  functional  relationship.  Howev¬ 
er,  this  class  is  by  no  means  inclusive  (See  Chapter  III  for  additional  examples).  Difficulties 
exist  in  determining  a-priori  if  the  problem  structure  has  an  infinite  optimal  sequence  where 
the  associated  multipliers  have  the  functional  relationship  {t>T,  T  finite).  Even  if 

no  optimal  exists  to  LP^  with  this  functional  structure,  dual  equilibrium  approximation 
still  provides  a  lower  bound  on  the  objective  function  (see  Chapter  IV),  however,  the  opti¬ 
mal  decision  variables  have  the  potential  of  being  infeasible  for  the  infinite  horizon  prob¬ 
lem  of  interest.  If  sufficient  conditions  are  met  which  ensures  that  the  dual  equilibrium 
approximation  converges  to  an  infinite  horizon  optimal,  (^.g.,Grinold  (1977)),  then  for  all 

finite  asT  there  exists  a  subsequence  S,  c  Z* ,  such  that  for  k  e  Sf, 

where  is  an  optimal  decision  variable  for  a  k  period  dual  equilibrium 


25 


formulation,  and  x^*  is  an  optimal  decision  variable  for  LP<>° .  This  does  not  necessarily 
imply  the  existence  of  a  finite  forecast  horizon  F,  such  that  if  k=F,  and  the  dual  equilibrium 
problem  is  solved,  the  resulting  is  optimal  to  LPoo  for  any  (0<t<F). 

2.  Primal  and  Dual  Equilibrium  Examples 

The  following  two  examples  illustrate  the  concepts  and  potential  shortcomings  of 
the  primal  and  dual  equilibrium  approximations. 

a.  Primal  Equilibrium  Assumptions  Satisfied 
In  this  example  LP®® ,  an  optimal  sequence  exists  that  satisfies  the  assump¬ 
tions  associated  with  primal  equilibrium. 

The  LPoo  of  interest  is: 

oo 

Minimize  ^  (0.9)  ^x^ 
t  =  o 

Subject  to: 

= '' 

x^>0  (t=0,l,2,...) . 

Property  /:  This  formulation  has  only  one  feasible  (and  therefore  optimal)  solution 

0.899  .  7  o  5  ^ 

for  all  (r=0, 1,  2,  3,...). 
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0  899 

Proof:  Clearly  ^t=f'^  feasible  since  for  all  (t=0,l,2,3,...) 


1  ¥0.899^  ^  0.899  ^  j 


0.899^‘-^'^^^  yo.899AL899)  1.899 


The  proof  shows  by  contradiction  that  this  is  the  only  feasible  solution.  As¬ 
sume  there  exists  some  feasible  sequence  {x,}  ^_q  such  that for  some  t.  We  first 
show  that  it  is  sufficient  without  loss  of  generality  to  consider  only  where 


X,  >  .  We  then  show  Xt+2>Xt  and  1  -  + 


0.899  yy  0.899 


1  Xf .  Using  this 


result,  it  can  easily  be  shown  for  any  finite  n>l  that  Xf+2n+2>^t+2n  and 


Xt+2n+2-^t+2n  ^  0.899^  Ao.899 


1  x,+2n  •  This  relationship  provides  a  contradic¬ 


tion  since  (a:,  <  . . . )  JC,+2„  for  (n=l,2,3...)  grows  without  bound  and  Xt<0.899 


for  all  t 


0.899 


Xt+x,  +  i  =  l  and  x„Xt^,>0\. 


0.899 


We  first  show  that  xf>Xf.j  implies  xf>Xt+ j  and  x,  >  ■  If  x^Xf.j,  then 


X,  >  since  x,_ ,  =  x -5,  (0  <  5  <  0.899)  which  implies  (x,  -  8)  +  x,  =  i 

1.899  u.oyy 


or  =  ^-^99  +  8  g.  _  _I_  (£  >  0)  ,  this  implies 

'  1.899  1.899  ‘  1.899 


1  (0.899 


0.899y  1.899 


+  £  +Xf^j  —  1  Xf^j  — 


1.899 

0.899  e  0.899 
1.899  0.899  1.899 


orxp»Xf+7.  From 


Xf.]<Xt>Xt+]  it  should  be  clear  that  it  is  sufficient  to  only  consider  xp>Xf.j 

Therefore,  without  loss  of  generality  consider  xp»x,.;,  and  note  that 


>  9:^22. .  Now  examine  the  relationship  between  x,+2  and  x,.  Since 

1.899 


0.899 


,x,  +  x,^,  =  1  X, 


0.899 
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fore  optimal)  solution  is  j ggg  (t=0,ly  2,...). 

QED  (Property  I) 

Applying  the  primal  equilibrium  approximation  (applying  the  additional 
constraints  xj=X2=X3...)  the  problem  reduces  to: 

Minimize  Xq  +  9Xj 
Subject  to: 

=  i 

1.899  _  j 

0.899^^ 

Xq,Xj>0 

This  formulation  has  an  objective  function  value  of  approximately  4.734 
mthxQ,Xj  =  =  0.4734 ,  which  are  optimal  for  the  infinite  horizon  problem.  This  prob¬ 


lem  exhibits  some  interesting  characteristics: 

•Solving  the  original  formulation  using  truncation  approximation  techniques, 
given  a  forecast  horizon  T,  yields  a  solution  x^,  (0<t<7)  which  is  not  optimal 
to  LPoo .  The  sequence  of  objective  function  values  and  optimal  decision 
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variables  (as  !->«>)  from  the  truncated  approximation  are  convergent 
(Romeijn,  Smith,  and  Bean  (1992))  to  the  optimal  values  for  LRo® ,  however, 
there  exists  no  finite  forecast  horizon  T  under  which  ,  for  any  (0^t<T)  is 
optimal  to  LPoo . 

•Solving  the  original  formulation  using  dual  equilibrium  approximation 
techniques,  given  a  forecast  horizon  T,  yields  a  solution  X(  ,  (0<r<T)  which  is 
■  suboptimal  to  LPo° .  The  sequence  of  objective  function  values  and  optimal 
decision  variables  (as  T  oo)  from  the  dual  equilibrium  approximation  are 
convergent  (Using  results  of  Romeijn,  Smith,  and  Bean  (1992),  and  Grinold 
(1983))  to  the  optimal  values  for  LP<=o ,  however,  there  exists  no  finite 
forecast  horizon  T  for  which  x^  for  any  {0<1<T)  is  optimal  to  LRoo . 

b.  Dual  Equilibrium  Assumptions  Satisfied. 

The  following  simple  example  of  LP^o  has  an  optimal  solution  sequence 
that  satisfies  the  dual  equilibrium  assumptions. 

oo 

Minimize  ^  {0.9)^ x^ 
t  =  o 


Subject  to: 

^0 

>1 

(0) 

0.8xq+  Xj 

>2 

U) 

0.8xj+  x^ 

>2 

(2) 

0.8X2+  ^3 

>2 

(3) 

Xf>0  {t=0,l,2...) . 

Applying  dual  equilibrium  method  with  a=0.9  (aggregating  with/discount¬ 
ing  constraints  (2)  onward)  generates  the  following  dual  equilibrium  approximation. 
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Minimize  Xq  +  0.9xj  +  0.81x2 
Subject  to: 


O.SXQ-i" 


0.8xj+  1.72x2  >20 


Xq,Xj,X2>0. 

This  approximation  has  an  optimal  objective  function  value  of  1 1 .0465  with 
X(^l,  X]=l.2,  and  JCj  =1 1.0698.  This  problem  is  an  example  of  the  ^:=PA  structure  (See 

i-I  1-2 

Chapter  III).  If  one  uses  the  formula  or,.  =  X;  X  (-^) '  ( P) '  +  ( P)  *  S®"" 

(=0  t=o 

erate  x^  {f>2)  with  p=0.8,  and  a: ;  and  Xq  are  optimal  solutions  to  the  truncated  formulation 
(which  equals  the  values  of  the  dual  equilibrium  formulation),  the  following  formula  is  de¬ 


rived; 


t  —  ^ 

a:.  =  2]^  {-1)^0.8*  +  1.2  {-1)'~\0.8)'~^  i>2 


It  can  be  shown  that  the  above  formula  generates  feasible  points  to  LP«> , 


and  that: 


X2=  X  «  =  11.0698. 

t-2 

This  sequence  is  feasible  io  LP<>=,  yet  provide  the  optimal  solution  to  the  re¬ 
laxed  formulation.  Therefore,  xq,  and  a;/,  the  optimal  solutions  to  the  relaxed  formulation, 

are  also  optimal  to  LPo° . 


3.  Summary 

All  of  the  approximation  methods  discussed  have  potential  pitfalls  regarding  end  ef¬ 
fects.  The  truncation  method,  completely  disregards  future  requirements,  and  the  other 
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methods  discussed,  (salvage,  fixed  end  conditions,  primal,  and  dual  equilibrium)  all  rely  on 
assumptions  regarding  the  infinite-horizon,  that  usually  cannot  be  verified.  However,  pri¬ 
mal  equilibrium  approximation  always  lead  to  upper  bound  optimal  objective  function  val¬ 
ues  for  LP°o,  and  dual  equilibrium  approximation  always  lead  to  lower  bound  optimal 
objective  function  values  for  LP°°  (See  Chapter  III  for  a  formal  proof).  Therefore,  as  the 
next  section  illustrates  primal  and  dual  equilibrium  approximations  together  can  provide  a 
tight  bound  for  the  infinite  horizon  optimal  objective  function  value.  This  provides  an  ef¬ 
fective  way  to  measure  any  remaining  end  effects  with  the  optimal  decision  variables  asso¬ 
ciated  with  the  primal  and/or  dual  equilibrium  approximations. 

B.  INFINITE  HORIZON  CONVEX  PROGRAMMING 

When  Cf  is  a  continuous  convex  function,  ,-)(x^)  is  concave  where  Xf  is  a  real  val¬ 
ued  vector  {i.e.,  a  member  of/?")  and  is  a  real  valued  vector,  MP«>  becomes  an  infinite- 
horizon  convex  program  S  voronos  ( 1 985)  conducted  research  in  the  areas  of  duality 

theory  and  finite-horizon  approximations  for  a  general  class  of  infinite-horizon  convex  pro¬ 
grams,  for  which  the  constraint  space  is  staircase  in  nature  (i.e., the  concave  period  t  con¬ 
straint  function  depends  only  on  variables  associated  with  either  period  t  or  t+1)  ^  The 
general  form  of  the  problem  follows  introduction  of  notation,  as  used  by  Svoronos: 


Indices: 

t 

Time  Period  {0,1, 2, 3...  T-1,  T,  T+l...). 

Data: 

a 

Discount  Factor  {0<a<l); 

n(t) 

Dimension  in  period. 

Decision  Variables: 

Xt 

period  current  production  vector  with  dimensions 

n(t)  X  7 ; 

'■Extension  of  contributions  by  Grinold  (1977, 1983a/b),  Manne  (1970, 1976),  Evers  (1973, 1983), 
among  others.  For  a  complete  listing,  see  Svoronos  (1985). 
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yt+i 

r*  period  lagged  production  vector  with  dimensions 

n(t+l)  X  1 . 

Decision  Space: 

St 

feasible  set  of  decisions  y^^  j). 

Functionals: 

Gt 

Closed  proper  concave  function  R\ 

Closed  proper  convex  function  R; 

ht 

Proper  convex  function  R"^^^  R', 

8t 

Proper  concave  function  R. 

Infinite  Horizon  Convex  Program: 

oo 

Minimize  ^  OLU^  (x^,  yf  +  j) 
t  =  o 

Subject  to: 

so(yo^  ^soiyo^ 

G,ix^,yt^i)  >0  (0<t<o^) 
h^ix^)  <g^iyi)  (0<t«>o) 

+  (0<t<oo) 

where  yg  is  given. 

It  is  important  to  note  that  this  convex  structure  is  general  in  nature,  and  includes  as 
an  important  subset  single  period  overlap  staircase  structured  linear  programs.  A  non-lin¬ 
ear  example  of  this  general  program  structure  used  by  Svoronos  (1985)  follows: 
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Example  Problem  Formulation: 


Minimize  ^  (-1)  alogx^ 
t  =  o 

Subject  to: 

ak\>x^  +  yf  (0<t<<=o) 

^t+i  =  K-^yt  (o^t<°°) 

Icq  given 

k^,yf,x^>0  (0<t<o=) 

a>0,0<b<  1. 

For  any  finite  forecast  horizon  T,  this  problem  involves  minimizing  a  strictly  con¬ 
vex  function  over  a  convex  feasible  region.  Therefore,  for  any  finite  forecast  horizon  T,  the 
optimal  solution  represents  a  unique  global  minimum  (Bazaraa  and  Shetty  (1979)). 
Svoronos  (1985)  illustrates  when  given  certain  regularity  conditions,  the  solution  of  the  in- 

finite-horizon  convex  program  also  has  a  global  minimum  . 

Convex  programs,  of  which  linear  programs  are  a  special  subset,  have,  as  a  rule,  an 
uncountable  number  of  possible  end  conditions  for  any  finite  horizon.  Because  of  this,  there 
is  no  assurance  in  general  for  the  existence  of  finite  forecast  horizons  (i.e.,  a  forecast  hori¬ 
zon  rfor  which  a  subset  of  the  optimal  decision  variables  to  the  T  period  approximation 
are  optimal  to  the  infinite-horizon  problem).  However,  Svoronos  (1985)  illustrates  for  a 
general  staircase  structure  convex  program,  (given  certain  assumptions  are  met),  that  T pe¬ 
riod  finite  horizon  approximations  generate  a  sequence  of  optimal  objective  function  values 
that  converge  in  the  limit  to  the  infinite  optimal.  He  also  shows  under  the  same  assumptions 
that  a  subsequence  of  the  optimal  decisions  generated  by  the  T  period  finite-horizon  ap¬ 
proximations  converge  point-wise  to  an  infinite  optimal. 


Svoronos  used  an  equivalent  class  of  problems,  where  the  problem  was  to  maximize  a  concave 
objective  over  a  convex  region. 
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1.  Bounding  Methods 

Svoronos  (1985)  was  the  first  to  propose  using  a  generalization  of  the  primal  and 
dual  equilibrium  approximations  to  bound  the  optimal  objective  function  value  for  the  in- 

finite-horizon  problem.^  For  infinite-horizon  convex  programs,  no  finite  horizon  T  exists 
in  general  for  which  the  optimal  decision  variable(s)  for  any  (0<t<T)  are  optimal 

for  the  infinite-horizon  problem.  If  the  objective  function  can  be  bounded  by  use  of  approx¬ 
imations  which  have  finite-horizon  formulations,  then  the  difference  between  these  approx- 

imations  can  be  used  as  a  measure  of  quality  for  the  decision  variable(s)  {Xf  ,  )  as 

compared  to  the  optimal  (;rf,y,+7)  for  the  infinite-horizon  problem.  The  general  algorithm 
is; 

•  Step  1.  Set  initial  forecast  horizon  T  Set  tolerance  level  £. 

•  Step  2.  Apply  variation  of  primal  equilibrium  approximation  to  the  convex  formulation. 

Add  functional  restrictions  as  needed  to  make  all  constraints  which  include  decision  vari¬ 
able  Xr+j  onward  redundant.  Evaluate  restricted  formulation.  Note  optimal  objective  value 

Z(TRestrict)  j  optimal  initial  period  decision(s)  jc  Note  that  is  feasible 

to  the  original  formulation. 

•  Step  3.  Apply  variation  of  dual  equilibrium  approximation  to  convex  formulation.  Aggre¬ 
gate/with  discounting  all  constraints  which  include  variables  att'+z  onward.  Evaluate 

relaxed  formulation.  Note  optimal  objective  value  Z  and  optimal  period  decision(s) 

^  TRelax  may  not  be  feasible  to  original  formulation. 

•  Step  4.  Evaluate  Z  (^Restrict)  _  ^  (TRelax)  jf  tjjg  difference  is  less  than  8,  stop.  Use  x 
as  your  choice  as  an  £-optimal  Xf.  Otherwise,  increment  T,  and  return  to  step  2. 

As  long  as  the  objective  function  values  of  both  the  primal  and  dual  equilibrium  ap¬ 
proximations  converge  to  the  infinite  optimal  objective  function  value,  this  algorithm 


This  idea  was  developed  independently  by  the  author  prior  to  finding  Svoronos  (1985)  unpub¬ 
lished  dissertation.  The  concepts  are  an  extension  of  work  done  primarily  by  Grinold  (1977, 
1983),  and  Manne  (1970, 1976). 
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provides  a  near  optimal  solution  for  the  decision  variable(s)  of  the  infinite-horizon  prob¬ 
lem.  Figure  2  illustrates  this  idea. 


Figure  2. 

Bounding  the  objective  function. 


2.  Using  Bounding  Methodology 

This  section  illustrates  how  the  above  bounding  algorithm  can  be  used  for  a  specific 
problem. 

Let’s  examine  the  following  linear  program: 


oo 

Minimize  ^  (xcx^ 
t  =  o 

Subject  to: 

Axq  ^s(O) 

KXq+  AXj  ^bil) 

Kxj+  Ax2  ^b{2) 

Kx2+  Ax^  '^b{3) 


x^>0  {t=0,l,2...) . 

Applying  primal  equilibrium  approximation  to  the  above  formulation  at  period  T 
(i.e.,  setting  Xt=Xf+j  for  t>T)  results  in  the  following  finite  period  approximation: 
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T-J  T 

f  a  cxj 

Minimize  >  a  cx.  +  — - 

^  *  l-a 

t  =  o 

Subject  to: 

AXq 

Kxq+  Axj 

Kxj+  Ax2 


>s{0) 

>b(l) 

>b(2) 


Kxj,_j+Axj  ^b{T) 

{K  +  A)Xj,  >b{T+l) 

x^>0  (t=0,l,2...,T). 


Applying  the  dual  equilibrium  approximation  to  the  original  formulation  from  pe¬ 
riod  r  onward  (aggregating  constraints  T  onward  discounting  with  factor  a)  results  in  the 
following  finite  period  formulation: 

T-I 

Minimize  ^  oc  cx^  +  a  cx^ 
t  =  o 

Subject  to: 


>s(0) 

>b{l) 

>b{2) 


Kxj._2'^  ^^t-1  >b(T-l) 

Kxj,_j+  (aiS:  +  A)A:^ 

x^>0  (t=0,l2,...,T-l)  x^>0. 

Increasing  the  solution  horizon  for  each  of  the  above  approximations  (i.e.,  in¬ 
creasing  7),  leads,  in  many  cases,  to  a  sequence  of  optimal  objective  function  values 
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which  form  a  convergent  sequence  for  both  primal  equilibrium  and  dual  equilibrium 
approximations.  Chapter  IV  discusses  the  issue  of  convergence  in  detail.  A  specific  exam¬ 
ple  uses: 

^  ^  \l.O  1.0  l.A  . 

[o.O  1.0  O.Oj  ’ 

^  ^  Fas  1.5  0.8  . 

[o.O  1.2  0.o\  ’ 

c  =  (1.0,  3.0,  2.0y, 
s  =  (1.0,  2.0); 
b  =  (13.0,  5.0); 
a  =  0.9; 

Applying  both  primal  and  dual  equilibrium  approximation  generates  the  bounds  shown  in 
Figure  3: 


Figure  3. 

Convergence  of  bounding  methodology. 


3.  Summary 

Svoronos  (1985)  shows  that  the  generalization  of  the  primal  and  dual  equilibrium 
approximations,  when  applied  to  a  class  of  convex  formulations,  converge  to  the  infinite 
optimal  solution  as  I  tends  toward  infinity.  Svoronos  requires  several  conditions  be  veri¬ 
fied  to  ensure  that  the  objective  functions  of  the  primal  and  dual  equilibrium  approxima¬ 
tions  converge  to  the  same  value,  and  therefore  converge  to  a  infinite  horizon  optimal. 
However,  the  more  practical  result  is  the  bounding  algorithm.  Using  both  primal  and  dual 
equilibrium  approximations,  it  is  possible  to  bound  the  error  associated  with  using  either 
approximations  decision  variables.  Therefore,  if  the  infinite-horizon  problem  structure  is 
completely  defined,  this  bounding  methodology  provides  a  method  to  eliminate  many  of 
the  end  effects  associated  with  finite-horizon  formulations  and  link  any  remaining  end  ef¬ 
fects  that  exist  with  the  primal  or  dual  approximations  to  the  size  of  the  gap  between  their 
respective  optimal  objective  function  values. 

C.  INFINITE  HORIZON  INTEGER  PROGRAMMING  AND  END 
EFFECTS 

Bean  and  Smith  (1984,  1985,  1993),  Ryan,  Bean  and  Smith  (1989),  and  Schochet- 
man  and  Smith  (1989, 1991, 1992)  investigate  problem  structures  for  which  finite  forecast 
horizons  exist  for  obtaining  optimal  initial  decisions  for  infinite  horizon  program  structures 
that  include  infinite  horizon  integer  programs  (IP°°).  Smith  and  Bean  (1984)  and  Schochet- 
man  and  Smith  (1992)  assume  in  general  the  following: 

•All  cost  functions  are  continuously  discounted.  The  necessary  level  of 
discounting  is  driven  by  the  nature  of  the  cost  function  and  is  required  to 
ensure  a  finite  cost  over  the  infinite-horizon. 

•All  problem  characteristics  are  deterministic.  The  problem  is  well  defined 
over  the  infinite-horizon. 

•  At  any  time  period  the  choices  available  are  finite  in  number.  This  is  a  critical 
requirement  to  ensure  existence  of  a  finite  forecast  horizon.  Schochetman  and 
Smith  (1992)  relax  this  assumption  so  that  feasible  choices  need  only  lie  over 
a  compact  space.  In  this  case,  since  the  number  of  feasible  choices  can  easily 
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be  uncountably  infinite,  the  definition  of  forecast  horizon  is  modified  to  be  a 
horizon  for  which  a  quantifiable  small  <6  tolerance  exists  (based  on  an 
imposed  metric)  between  an  infinite  optimal  and  candidate  optimal  solutions. 
This  assures  the  existence  of  some  finite  T  period  approximation  such  that  the 
solution  obtained  is  5  optimal  to  the  infinite-horizon  problem. 

•All  cumulative  net  cost  functions  are  the  difference  of  a  monotone  cost 
function  and  a  monotone  revenue  function,  both  of  which  are  uniformly 
bounded  by  some  exponential.  This  requirement  helps  to  ensure  the  existence 
of  a  feasible  finite  cost  over  the  infinite-horizon. 

Bean  and  Smith  (1984)  define  any  sequence  of  decisions  which  cover  the  infinite- 

horizon  as  a  strategy,  and  the  individual  decisions  associated  with  any  strategy  as  policies'^. 
A  further  assumption  is  made  that  the  infeasibility  of  any  strategy  is  a  property  that  can  be 
identified  by  observing  at  most  finitely  many  initial  policies. 

1.  Problem  statement 

The  sequence  7t  ={7ti,  K2, 113, ...}  is  a  strategy  where  each  element  Kf  is  a  policy.  The 
number  of  available  policy  choices  for  Kf  is  finite  and  the  feasible  policy  set  is  a  function 
only  of  past  policies  (7t2,7t2v%-i)-  L^t  IT  be  the  set  of  all  feasible  strategies. 

Let  C^(t)=  .K'n(t)-/frt(t)  where  /^^^(t)  and  Kff(t)  are  assumed  to  be  non-decreasing  func¬ 
tions  on  and: 

0^jj(t)<Mc^  for  all  t>T,  some  y^; 

for  all  t>T,  some  y^. 

Define  the  net  cost  as: 


Cff  (r)  =  je  (t)  (Note:  r>y  as  a  rule  to  ensure  convergence). 
0 


Strategy  is  the  term  used  by  Bean  and  Smith  to  define  a  sequence  of  decisions  feasible  over  the 
infinite-horizon.  Svoronos  (1985)  uses  the  term  trajectory.  Both  terms  are  in  essence  identical. 
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The  problem  of  interest  then  is: 

Minimize  (r) 

Subject  to: ne  IT. 

This  problem  definition  includes  any  class  of  problems  such  that  the  solution  space 
at  any  particular  decision  point  is  cost  bounded,  including  mathematical  program  formula¬ 
tions  for  which  k  represents  any  feasible  sequence  of  decision  variables  (xq,  xj,  X2,  Xj,...) 

OO 

over  some  defined  region  X,  and  (r)  is  defined  as  X  ,  where  c,  and  Xf  are  vec- 

1  =  0 

tors  in  R^.  The  main  over-riding  assumption  is  that  the  feasible  Xj  lies  in  a  non-empty  com¬ 
pact  region  (based  on  the  defined  metric)  for  all  t. 


2.  Topology  of  feasible  space 

Smith  and  Bean  (1984)  impose  a  metric  topology  over  the  feasible  strategy  space, 
and  using  the  associated  inherited  properties  of  metrics  show  the  existence  of  finite  forecast 
horizons.  This  section  provides  a  brief  summation  of  the  defined  metric,  and  some  of  the 
key  results  derived  by  Smith  and  Bean. 

Let  K  and  7C'  be  two  strategies  in  11.  Define  the  distance  between  Ttf  and  7i'/  (where 


these  represent  the  policies  in  strategy  %  and  %'  respectively)  as: 


4>  (TCj,  K\) 


^  I  if  t^ policies  different 
kO  if  t^ policies  same 


This  metric  holds  when  the  number  of  decision  choices  for  is  finite.  If  the  number 

of  choices  is  not  finite,  but  forms  a  non-empty  compact  subset  of  and  the  feasible 
space  is  compact,  the  standard  Euclidean  norm  is  used  (Schochetman  and  Smith  (1992)). 
Further,  define: 


p  (It,  It') 


t  =  i 
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Smith  and  Bean  (1984)  and  Schochetman  and  Smith  (1989,  1991, 1992)  prove  the 
following  key  results: 

•(p,n)  is  a  metric  space  and  n  is  compact  (i.e.,  complete  and  totally  bounded) 
in  the  metric. 


•Given  p(7t,  JC'  )<8<i/2",  and  the  decision  space  is  finite  with  the  finite  metric, 
then  <|)  (n„  n',)  =0  for  all  t<n,  which  implies  Jt,=7t/  for  all 


•If  Um, 


<  r ,  then  the  cost  function  is  bounded. 


T 

•Define  C„  (r,  T)  =  \e"‘dC^  {t)  ,  to  represent  the  total  cost  of  any  feasible 

0 

strategies  over  the  horizon  [0,71.  Also  define  any  Min  (r,  T)  as 

C*(7).  Then  C*{T)  converges  to  the  infinite  optimal  solution  C*  as  T  . 

•If  the  infinite-horizon  optimal  strategy  7t*is  unique,  then  the  optimal  strategies 
associated  with  the  I  period  problems  k*(T)  converge  to  n*  as  T  -4  «>. 

•Given  a  finite  set  of  possible  solution  policies  at  each  decision  epoch,  and 
given  any  policy  period  t  of  interest,  there  exists  some  T  for  which  7t/7) 
(t<T<°o)  is  an  optimal  TZf  policy  for  the  infinite-horizon  problem.  If  the 
solution  space  is  not  finite,  then  under  the  revised  metric  (using  the  Euclidean 
norm),  there  exists  some  Tfor  which  the  Euclidean  norm  of  (7i:,(T)-7ij)<8 
(where  ;<T<«>),  where  n^T)  is  the  optimal  policy  obtained  using  a  T period 
approximation  and  is  an  optimal  policy  for  the  infinite-horizon  problem. 
Tt/T)  is  defined  as  a  5  optimal  policy  for  the  infinite-horizon  problem. 

•Given  the  infinite-horizon  optimal  strategy  7C*  is  unique,  there  exists  some  T* 
for  each  t>0,  for  which  (T>T*)  is  an  optimal  7C,  policy  (or  6  optimal  if 
the  number  of  choices  is  infinite)  for  the  infinite-horizon  problem. 

•Given  the  first  L  policies  of  any  optimal  strategy  n*  are  unique,  there  exists 
some  T*  for  each  t  where  0<t^,  such  that  tc^T)  (all  T>T*)  is  an  optimal  %t 
policy  (or  5  optimal  if  the  number  of  choices  is  infinite)  for  the  infinite- 
horizon  problem. 
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3.  Stopping  Rule  Criteria 

Stopping  rule  criteria  proposed  by  Bean  and  Smith  (1984),  ensure  that  a  finite  fore¬ 
cast  horizon  can  be  identified  for  initial  decision  policies.  Schochetman  and  Smith  (1989, 
1991,  1992)  further  develop  stopping  rule  criteria  for  finite  and  compact  feasible  solution 
sets  by  essentially  solving  finite-horizon  problems  over  a  finite  cover  of  potential  ending 
conditions  and  examining  the  resulting  efficient  set  (defined  by  Schochetman  and  Smith 
(1992))  of  optimal  solution  sequences  This  approach  is  similar  to  the  fixed  end  effects  ap¬ 
proximation  method  presented  in  the  linear  programming  section,  except  instead  of  guess¬ 
ing  an  optimal  end  condition,  the  approach  examines  all  potential  end  conditions. 
Schochetman  and  Smith  (1989, 1992)  also  modify  the  stopping  rule  criteria  to  deal  with  the 
problems  associated  with  isolating  an  infinite  optimal  when  multiple  infinite  optimal  so¬ 
lutions  are  possible.  For  a  detailed  discussion,  see  Schochetman  and  Smith  (1989,  1992). 

4.  Applicability  to  the  end  effects  problem 

The  general  staircase  structure  represents  a  fairly  robust  subset  of  infinite-horizon 
mathematical  programs,  including  infinite-horizon  bounded  integer  formulations.  The 
main  difficulty  lies  in  implementing  the  stopping  rule  criteria  proposed  by  Smith  and  Bean 
(1984),  and  more  recently  the  modified  stopping  rules  of  Schochetman  and  Smith  (1989, 
1992)  when  the  number  of  possible  ending  conditions  is  large  or  uncountable.  For  example, 
if  the  discrete  mathematical  program  of  interest  is  an  infinite-horizon  integer  program,  each 
T  horizon  problem  itself  may  be  NP  hard  (or  complete).  As  a  rule,  exact  solutions  are  re¬ 
quired.  Solving  a  number  of  integer  programs  that  is  equal  to  the  number  of  potential  end 
conditions  (re-solving  for  each  end  condition)  at  each  time  step  T,  and  then  dealing  with  the 
associated  multiple  optima,  can  quickly  become  computationally  impractical. 

D.  SUMMARY 

Of  all  the  methods  examined  in  this  chapter  to  deal  with  end  effects,  the  concept  of 
extending  the  problem  formulation  over  the  infinite  horizon,  and  then  solving  bounding  ap- 
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proximations  using  primal  and  dual  equilibrium  approximations  appears  to  be  the  most  vi¬ 
able  and  practical  approach  in  eliminating  end  effects  associated  with  finite-horizon 
formulations.  The  extension  and  implementation  of  this  methodology  is  the  focus  for  the 
following  chapters  of  this  dissertation. 
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III.  LPoo  STRUCTURES  THAT  SATISFY  DUAL  EQUILIBRIUM 


When  an  infinite-horizon  problem  has  an  optimal  solution  structure  that  satisfies 
the  assumptions  of  dual  equilibrium  for  some  finite  T,  the  dual  equilibrium  approximation 
provides  an  optimal  solution  to  the  infinite-horizon  problem  and  end  effects,  by  definition, 
are  eliminated.  As  discussed  in  Chapter  I,  few  examples  exist  of  infinite-horizon  problem 
structures  for  which  the  form  of  the  infinite-horizon  optimal  solution  is  known.  In  order  to 
gain  insight  regarding  the  impact  of  end  effects  on  LP°°,  this  chapter  presents  several  simple 
problem  structures  and  shows  the  dual  equilibrium  approximation  generates  optimal  feasi¬ 
ble  solutions  to  the  original  infinite-horizon  problem. 

Sections  A  through  D  show  several  simple  problem  structures  that  have  optimal  pri¬ 
mal  and  dual  decision  variables  which  can  be  formed  as  a  function  of  the  optimal  primal 
and  dual  decisions  generated  by  a  two  period  truncated  model.  Section  E  derives  the  limit¬ 
ing  optimal  primal  and  dual  decision  variables  functional  relationship  as  the  solution  hori¬ 
zon  extends  to  +°°.  The  results  of  Romeijn,  Smith,  and  Bean  (1992)  show  the  limiting 
values  are  optimal  over  the  infinite  horizon.  These  infinite-horizon  optimal  solutions  satis¬ 
fy  functional  relationships  assumed  by  dual  equilibrium  approximation,  therefore,  any  op¬ 
timal  solutions  generated  by  using  dual  equilibrium  approximation  are  also  optimal  for  the 
infinite-horizon  problem. 

A.  K=pA  SINGLE  PERIOD  OVERLAP  STAIRCASE  STRUCTURE 

The  problem  P(pA)  has  a  single  period  overlap  staircase  structure  with  a  constant 
right  hand  side  following  the  first  period  which  is  shown  below: 
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oo 


>s  (0) 
>b  (1) 
>b  (2) 

H^k-2 

x^>0,  (i=0,l,2...) . 

The  associated  dual  D(PA)  is: 


Maximize  UqS  +  ^  ufi 
i  =  l 

Subject  to: 

UqA+  «^pa 

+v 

=  C  iO) 

UjA+  U2^A 

+  Vjl 

=  ac  (1) 

U2A+  M^PA 

+  V 

=  ac  (2) 

u^_jA+ 

MjfcpA 

=  a*"^c  (k-1) 

u^>0,  v.>0,  (i=0,l,2...) . 

For  the  above  problems,  p  is  a  constant  such  that  0<^<1,  and  0<a<l.  To  ensure 
strong  and  weak  duality  hold  in  the  limit  (Romeijn,  Smith,  and  Bean  ( 1 992)),  A>0,  and  c>0 
are  also  imposed. 

Property  II:  For  any  finite  k  period  (k  even)  truncation  of  F(pA),  defined  as  P{k^A), 
if  Vq  >  otP^Vy ,  there  exists  an  optimal  set  of  decision  variables  {x,- }  ,  {Wy }  ,  and 


Minimize  ^  (xcx^ 

i  =  0 

Subject  to: 

AXq 

PAxp  +Ax^ 

PAXy  +Ax2 
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{  vf }  (primal,  dual,  and  dual  slack  variables  respectively)  of  the  form: 


k 

Xq  =  Xq, 

k 

Xj  =  Xj-, 

n=0  n=0 

{.k-2) 

2 

“o  =  “o  2 

n  =  0 

k-(i+  1) 

ul  =  X  .(-^)”(aP)” 

n  =  0 

f  (k-4)/2  \  f  (k-4)/2 

vJ  =  Po^+(ap)^  X  (ap)^”  -V;  ap^  X  (“P^  ” 

V  n  =  0  '  ^  n  =  0 

V*  =  a~^Vj  (l<i^-l). 

Where  Ug,  u„  Xq,  x„  Vg,  V; ,  are  the  associated  optimal  solutions  to  the  two  period  trun¬ 
cated  problems: 

P(2PA)  (Two  period  Truncated  Primal) 

Minimize  cXq  +  acx j 

Subject  to: 

Axq  >s 

PAxq  +  Ax^  >  b 

Xq,Xj>0-, 
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D(2PA)  (Two  period  Truncated  Dual) 
Maximize  UqS  +  Ujb 


Subject  to: 


UqA+Uj^A+VqI 


Uq,Uj,Vo,Vj>0. 


+  VjI  =  ac 


Proof:  Along  with  primal  and  dual  feasibility,  the  optimal  solution  sets  for  P(2|3A) 
and  D(2pA)  also  satisfy  complementary  slackness.  That  is: 

Uq(Axq-s)  =  0; 

Uji^Axg  +  Axj-b)  =  0; 

^0^0  = 

^1^1  =  0- 

The  proof  shows  the  solution  structure  presented  above  satisfies  (1)  primal  feasibility,  (2) 
complementary  slackness,  and  (3)  dual  feasibility  (Karush-Kuhn-Tucker  (KKT)  require¬ 
ments  for  optimality).  First  let’s  define  the  arbitrary  k=even  period  primal  and  dual  prob¬ 
lem  structures  of  interest; 

P(kpA) 

k-l 

Minimize  ^  oc  cx^ 
i  =  0 

Subject  to: 

AXq 

PAjCp  +AXj 

^Axj+Ax^ 


x.>0,  (i=0,l,...k-I) ; 
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D{k^A) 


k-l 

Maximize  UqS  +  ^  u-b 
i  =  l 

Subject  to: 

UqA+  MypA 

+  V 

=  c 

«yA+  U2^A 

=  ac 

«2A+  m^PA 

+  V 

2 

=  a  c 

k-2 

=  a 

!V 

Uk_iA 

v.>0,  (i=0,l,...k-l). 

k-l 

=  a  ( 

(1)  Show  primal  feasibility  holds,  i.e.,  show  that  the  constraints  of  P(A:pA)  are  satisfied: 
xj^>0  (l<i^-iy,  (1) 

(2) 

^Axf.j'^+Ax/^^  (l<i^-l).  (3) 

Given  primal  feasibility  satisfied  for  P(2pA): 

Xq>0; 

xj>0- 

AXq>s; 
pAjCQ  + >b. 

Equation  (1)  holds  for  i=0  and  i=l,  since  xl  =  Xg  and  x]  =  x,.  Equation  f/j  holds  for 


2<i^-l  since Xg, X]>0,  Xi  = 


i~l 


i~2 


i,l  M)  P  M)T 


n^O 


n  =  0 


(2<i^-l),  and 


^  (-7)  ”P”  >  0  (l<i^-l) ,  (the  latter  can  easily  be  shown  by  induction). 

n  =  0 


49 


Equation  {2)  holds  as  x\  =  Xq.  Equation  (3)  holds  when  i=l  since  xl  =  Xo  and  x]  -  Xj. 

k  /V 

When  i  is  greater  than  one,  substituting  x,  =  Xj  or 

X-  =  \x,Z  (-i)"P"+^oPS  (2<i^-l)  (hypothesis), 

as  appropriate  leads  to  the  equality  b  <  +  Axj  =  PAa:,  _;  +  Axi ,  (l<i^-l),  and 

x]>0.  Therefore  primal  feasibility  is  satisfied. 

(2)  Show  that  complementary  slackness  holds  between  the  optimal  primal  and  dual  vari¬ 
ables  for  P(itpA)  and  D(k^A),  i.e.,  show  that: 

u^iAx^o-s)  =0;  (4) 

u.{^Ax\_^j+Ax\-b)  =  0  (5) 

V^x]  =  0  (0<i^-l).  (6) 

Given  complementary  slackness  between  the  optimal  primal  and  dual  variables  for 
P(2pA)  and  D(2PA): 

UoiAxQ-s)  =  0; 

u j  (^^Ax Q  +  Ax j  —  b')  —  0, 

VjXj  =  0. 

Substituting  =  «/  S  («P)  and  =  x,  (both  from  hypothesis).  Equation  (4) 

n^O 

is  equivalent  to  multiplying  Uq  (Axq  +  s)  by  a  scaler  value.  Therefore  equation  (4)  holds. 
Substituting  uf  =  u[a-'x  x''  (-i)"  (ap)")  (hypothesis),  and  recogniz- 

ing  that  pAxo  +  Ax^  =  pAx._  ^  -h  Ax.  (from  primal  feasibility  results),  equation  (5) 
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(l<i^-l )  is  equivalent  to  multiplying  Uj  ( +  Axj  -b)  =  0  by  a  scaler.  Therefore 


equation  (5)  (l<i^-l)  holds. 

To  show  equation  (6)  holds  we  need  the  requirement  Vg  >  ap^V; .  Examining  ,  the  fol¬ 
lowing  equivalent  relationship  holds: 


v^o  =  =  v^o  1  (aP)  -vA  ar  1  (aP)'"  .(7) 


Note  that  VgjCg  =  0  as  complementary  slackness  holds  for  the  two  period  problem.  In 
addition  0 <  a^^v,Xo <  VgJCg  =  0 ,  since  Vg,  Vj, Xo>0  ,  ap^> 0,  and  Vg >  ap^V; . Therefore, 

k  k 

VjXq  =  0.  Substituting  these  equalities  into  equation  (7)  leads  to  VgOCg  =  0. 

Showing  v]x]  =  0  is  trivial  since  x]  =  X;  and  v*  =  v, .  Therefore  v]x]  =  VjX,  =  0 . 
To  show  =  0  (2<i^-l),we  need  v,Xo  =  0,  which  is  shown  above.  Substituting 


Xi=  (-/)"P"+^(,PI  M)"P"  ('2<i^-ij,andv*  =  a''^V;(2</^-7j,we 


obtain  v^x^  =  a‘~’vjXj  X  (-^)  "P"  +  »^/^oP  X  (-^)  "P"  (2<i^-l)  ■  Recognizing 


VjX,  =  0  and  V;JCg  =  0,  this  leads  to  v-xf  =  0  (2<i^-l) .  Complementary  slackness  is 
satisfied  for  all  k=even  period  truncated  problems. 


(3)  Show  dual  feasibility  holds,  i.e.,  show  that  the  constraints  of  D(k^A)  are  satisfied: 
jA  +  afpA  +  vf_ ^  -  a  ~^c  =  0  (l<i^-l);  (8) 

ul_iA  +  vl_iI-a~^c  =  0.  (9) 
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Note  that  u^A  +Uj^A-c  =  -v^I  (Z)(2pA)  first  constraint).  Substituting  the  equations 

c-VqI  =  UqA.  +  ,  and  ac  -  Vjl  =  u^A  (a  rearrangement  of  the  constraints  for 

Z)(2PA)),  we  discover  that  the  above  equation  reduces  to: 

k-2  k-4 

n=0  n=0 

Since  v*o  must  be  greater  than  or  equal  to  zero,  we  can  derive  a  relationship  that  must  hold 

for  any  k=even  between  and  v,,  i.e., 
k-2  k-4 

(aP)"“2V«P'2  (“P)'"-- 

n  =  0  n  =  0 

Note  that  for  all  (k=even),  if  Vq  >  v^ap^  (hypothesis),  the  above  equation  holds.  There¬ 
fore,  equation  (8),  when  i=l,  is  feasible  for  all  k=even.  Equation  (8),  (1  can  be 

shown  to  hold  by  substituting  «j_ ;  =  a/a'  (-i)"(aP)  j,and 
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k-a-n) 


u]  =  M;  a‘'^x  X  (-i)"(ap)"]  (hypothesis).  Substituting  the  above  into  equation 


(8)  provides  the  equivalent  expression 


u^A  a 


1  k  i-1 

1  +  ^  i  (aP)  ”  -  ( aP)  ”)  +  Vj  _  jl-a  c  which  is  equivalent  to: 


a'  ^u,A  +v^i_,I -a'~'c . 


Noting  that  UjA  +  Vjl  =  ac  (i</^-i)(D(2pA)  second  constraint)  and  letting 

(from  hypothesis),  substituting  these  relationships  into  equation  (70),  one 

obtains  a  («^A  +  v^I-ac)  .  Equation  (8)  (l<i^-l)  is  equivalent  to  multiplying  the 

second  constraint  of  D(2pA)  by  a  scaler.  Therefore,  equation  (8)  holds  above  for  all 
k=even  period  problems. 

Equation  (9)  holds  when  (hypothesis),  UjA  +  VjI  =  ac  (7)(2pA)  sec¬ 
ond  constraint),  and  =  V  jU  (hypothesis)  is  substituted  into  the  equation.  Equa¬ 


tion  (9)  is  then  equivalent  to: 


Uja^  ^A  +  v^_y/-a''  'c  =  a"  ‘I  a^A +  . 


k-l  k-2 


k  j 

^k-i^ 
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Which  is  equal  to  a*  ^  {u^A  +  v  -ac)  =  0.  Under  the  hypothesis.  Equation  (Pj  is 

equivalent  to  multiplying  the  second  constraint  of  D(2pA)  by  a  scalar.  Therefore,  dual  fea¬ 
sibility  (equations  (8)  and  (9))  is  satisfied.The  hypothesis  variable  sets  satisfy  KKT  condi¬ 
tions  for  P(jtpA)  and  D(k^A)  for  any  Uneven  period  formulation. 

QED  {Property  11) 

The  proof  derives  a  functional  relationship  for  the  optimal  primal/dual  decision 
variables  of  the  truncated  problem  over  any  even  period  solution  horizon.  This  functional 
relationship  depends  only  on  the  optimal  decision  variables  for  the  two  period  truncated 
formulation,  and  the  length  of  the  solution  horizon.  The  following  sections  examine  several 
special  cases  and  extensions  of  this  problem  structure. 

B.  SPECIAL  CASE:  P(pA)  WITH 

The  problem  P{^ADemand),  p5^,  has  the  following  structure; 


oo 

Minimize  ^  CLcx. 
i  =  0 

Subject  to: 

AXq  (0) 

\)Axq  +Axi  (^) 

PAjCy  +Ax2  (2) 

pAx^_2  +Ax^^j  >b(k-l) 


x.>0  {i=0,l,2,...) . 
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The  associated  dual  D(^ADemand)  is: 

00 

Maximize  UqS  +  ^  u-b 

i  =  l 

Subject  to: 

UqA+  Uj^A 

+V0I  =  C 

u^A+  «2p^ 

+VjI  =  ac 

U2A+  «jPA 

+V2/  =  a  c 

Ui^_jA+  M^pA 

r 

+Vj.,/=a 

u^>0,  V.  >0,  (i=0,l,2,...) . 

For  the  above  problems,  P  is  a  constant  such  that  0<^<1,  and  0<a<l.  To  ensure  strong  and 
weak  duality  hold  in  the  limit  (Romeijn,  Smith,  and  Bean  (1992)),  A>0,  and  c>0  are  also 
imposed. 

Property  III:  An  optimal  solution  to  P(^ADemand)  exists  where  Xj  =  0. 

Proof.  Prove  by  contradiction.  Assume  there  exists  an  optimal  sequence 
{JCo,  Xj,  X2,  X5,  . . . }  to  Pi^Demand)  such  that  X]>0.  Now  examine  the  change  in  the 

objective  function  for  the  new  sequence  {Xg,  0,Xj+X2,X2,  ... }.  This  sequence  is  still  fea¬ 
sible  since: 

Xi  >0'^i; 

Axq  >  s  (Constraint  (0)  of  P(^ADemand)); 

PAxq  +  A{0)  >b  Since  >^s>b  (Constraint  (7)  of  P(^ADemand)); 

PA  (0)  +  A  (Xj  +  X2)  >  PAxy  +  Ax2  >  b  (Constraint  (2)  of  P(^ADemand));  and 

pA  (x,  +  X2)  +  Ax 2  >  pAJc2  +  AJc^  >  b  (Constraint  (3)  of  P(^ADemand)). 
However,  note  the  change  in  objective  function  value.  The  objective  function  of  P(pADe- 
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mand))  in  period  (1 )  decreases  by  the  amount  acxj  since  x,-^0.  The  objective  function 
of  Pi^ADemand))  in  period  (2)  increases  by  the  amount  acx,  since  X2^x,+X2.  This 

leaves  a  net  decrease  in  the  objective  function  value  for  P(^ADemand))  of  {a-a)cX]. 
Therefore,  if  any  optimal  sequence  to  P{^ADemand))  must  have  x,  =  0.  For  the 
trivial  case  where  c=0,  the  feasible  solution  with  Xj  =  0  is  an  alternative  optimal. 

QED  {Property  III) 

Given  there  exists  an  optimal  solution  to  P{^ADemand)  with  Xj  =  0 ,  the  problems 
{PSubl)  and  {PSubl)  shown  below  are  equivalent  to P{^ADemand)  with  x,  =  0\ 


Minimize  ^  acx^ 

i  =  2 


r Minimize  cXq 


Subject  to: 
AXq>s 


(PSubl)  + 


Subject  to: 

AX2 

^AX2  +-^^5 


+Ax^ 


>b 

>b 

>b 


(PSubl). 


Xi>0,  0<^<1 

(i=2,3,...) 


Therefore,  for  a  P(^ADemand)  problem  the  optimal  first  period  solution  is  found  by  solv¬ 
ing  the  one  period  truncated  problem.  Note  that  (PSubl)  is  just  a  special  case  of  P(PA) 


where  s=b. 


C.  P(PA)  WHERE 

The  primal  and  dual  formulations  (defined  as  P(fiARHS)  and  D(^ARHSi)  respec¬ 
tively)  for  the  case  when  s=b  are  shown  below: 
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Pi^ARHS) 


oo 

Minimize  ^  acx^ 

izzO 

Subject  to: 

Axq 

^AXq  +Axj  ^  b 

PAXy  +Ax2 

PAx^_2  ^b 


x.>0  {i=0,l,2,...) . 

Di^ARHS) 

oo 

Maximize  ^  ufi 
i  =  0 


Subject  to: 

UqA+  «yPA 

+v 

WyA-t-  U2^A 

+  Vy/  =  ac 

U2A+  M^pA 

_  2 

+  V2I  =  a  c 

Ui^_jA+  My^pA 

T 

+  Vjt_y/=  a 

u.>0,  Vj. >0,  {i=0,l,2...) . 

Property  IV:  For  any  finite  k  period  {k  even)  truncation  of  P{^ARHS),  there  exists 
an  optimal  set  of  decision  variables  {x*}  ,  {af}  ,and  {v*}  (optimal  primal  and  dual  vari¬ 
ables  respectively)  of  the  form: 
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n  =  0 

k- (i+7) 

n  -  0 

V.  =  av^. 

Where  Xg,  Uq,  ’  are  the  associated  optimal  solutions  to  the  one  period  truncated  prob¬ 
lems: 

P{1^ARHS)  (One  period  Truncated  Primal) 

Minimize  cXq 

Subject  to: 

Axq  >b 

Xq>0-,  and 

D(l^ARHS)  (One  period  Truncated  Dual) 

Maximize  UQb 

Subject  to: 

UqA  +  VqI  =  c 

Uo,Vq,  >0. 

Proof:  Along  with  primal  and  dual  feasibility,  the  optimal  solution  sets  for 
P(l^ARHS)  and  D(l^ARHS)  also  satisfy  complementary  slackness.  That  is: 

UQ(AxQ-b)  =  0; 

VoXo  =  0. 

The  proof  shows  that  the  solution  structure  presented  above  satisfies  (1)  primal  feasibility, 
(2)  complementary  slackness,  and  (3)  dual  feasibility  (KKT  requirements  for  optimality). 
First  let’s  define  the  arbitrary  k=even  period  primal  and  dual  problem  structures  of  inter¬ 
est: 
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Pik^ARHS) 

k-l 

Minimize  ^  a  cx^ 
j  =  0 

Subject  to: 

Axq 

^Axq  +AXj 

^Axj  +Ax2 

x^>0,  (i=0,l,2,...,k-l) . 

Dik^ARHS) 

k-I 

Minimize  ^  u^b 
i  =  o 

Subject  to: 


UqA+  Uj^A 

+V0I  =  c 

UjA+  U2^A 

+v^I  =  ac 

,  2 

U2A+  KjPA 

+V2I  =  a  c 

,  k-2 

+Vk-2^  =  a  c 
,  k-I 

Uk_iA 

+Vi^_jI  =  CL  C 

U.  >  0, 

v.>0,  ii=0,l,2....k-l). 

(1)  Show  primal  feasibility  holds,  i.e.,  show  that  the  constraints  of  P(k^)ARHS)  are  satis¬ 
fied: 


xt>0-. 

(11) 

Aj:/>4; 

(12) 

>b 

>b 

>b 
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(13) 


Non-negativity  (equation  (11))  is  satisfied  since  at*  =  2  (O^i^-1)  and 

n  =  0 
i 

£  (-7)  "P"  >  0  (i^)  (easily  shown  to  hold  by  induction).  Given  the  primal  feasibility 

n  =  0 

constraint  A >  &  is  satisfied  for  P(7pAi?H5),  substituting  Xq  =  Xg  (hypothesis)  into 
equation  (12),  primal  feasibility  is  satisfied  for  all  k=  even  period  problems.  When  (Ki^- 

i 

7,  substituting  X  (hypothesis),  as  appropriate  into  equation  (75)  leads 

n  =  0 

to  the  equality  ^Axl,  +  Aat*  =  A  (p4_/  +  4)  =Axo>b,  (l<i^-l).  Therefore  primal 
feasibility  is  satisfied. 

(2)  Show  that  complementary  slackness  holds  between  the  optimal  primal  and  dual  vari¬ 
ables  for  P(k^ARHS)  and  D(k^ARHS),  i.e.,  show  that: 

H*  (AxQ-b)  =  0;  (14) 

u\  (  Pa4_  i+Ax\-b)  =  0  (M^-1) ;  (15) 

v]x^  =  0  (0<i^-l) .  (16) 

Given  complementary  slackness  between  the  optimal  primal  and  dual  variables  for 
PU^ARHS)  and  D(7pA7?775); 

UQ(AxQ-b)  =  0; 

VqXo  =  0. 

Substituting  «o  =  Uq^  ^  (-7)”(ap)"^  andx^  =  Xq  (both  from  hypothesis).  Equation 

n  =  0 

(14)  is  equivalent  to  multiplying  Ug  (Ax^  -b)  =  0  by  a  scaler  value.  Therefore  equation 
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holds.  Substituting  «*  =  a  Mol  X  (--/)"(oc(3)"J  (hypothesis)  and 

PA:f_y+xf  =  Xq  (resultofverifyingprimalfeasibility),  equation  (75)  (7 is  equiva¬ 
lent  to  multiplying  Uq  (AXq  -b)  =  0  by  a  scaler.  Therefore  equation  (75)  (l<i^-l) 

i 

holds.  Noting  that  X  and  v*  =  dvo(0<i^-l), 

n  =  0 

v'lx'l  =  Vo^o«'  X  =  Oxa!^  (-7)"P"  =  0(0<i^-7).  Equation  (75)  is  satis- 

n-0  n=0 

fied.  Complementary  slackness  satisfied  for  all  k=even  period  truncated  problems. 

(3)  Show  dual  feasibility  holds,  i.e.,  show  that  the  constraints  of  D{k^ARHS)  are  satisfied; 
u’^  jA+u^^A+v'^  jI-d  =  0  (l<i^-l);  (17) 

ul_jA  +  vl_jI =  0.  (18) 

Given  dual  feasibility  UqA  +  VqI  -c  =  5  is  satisfied  for  D(7PA7?77S). 

Lets  examine  equation  (17)  (l<i<k-l)  in  the  following  form: 

m*_^A +M*pA +v._^/-a*  =  ( (u.  y -I- M.  P)  A  +  Vj._y/-a  c) .  (19) 

Substituting  uf.;  =  d  ^ul  (-7)"(aP)"l  and  m,-  =  cluI  ^  (-7)  (ocp) 

into  Ui.j  -I-  M* p  leads  to  the  equality  m*./  +  M*p  =  d''uo .  Substituting  this  into  the  right 
hand  side  of  equation  (19)  one  obtains  d'^UgA  +  v'l.jl  -  d'^c .  Now  note  that 

=  d~'vo  (hypothesis).  Using  these  two  equations,  we  discover  that  equation  (77) 

under  the  hypothesis  reduces  to  oc"  (UqA  +  VqI  —  c)  =  0 .  Equation  (77),  7<i<k-7,  is 
feasible  for  all  k=even.  Equation  (18)  holds  when  Uf^_j  =  ot  uo  (hypothesis),  and 
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v\_,  =  a'' Vo  (hypothesis),  are  substituted  into  the  equation.  Equation  ( 18)  is  then  equiv¬ 
alent  to: 


a*  ^UqA+o!^  ^VQ-a  =  a  (UqA  +VqI  -c)  -  0. 

Under  the  hypothesis,  Equation  (iSj  is  equivalent  to  multiplying  the  constraint  of 
D{1^ARHS)  by  a  scalar.  Therefore,  dual  feasibility  (equations  (17)  and  (18))  is  satis- 
fied.The  hypothesis  variable  sets  satisfy  KKT  conditions  for  P(k^ARHS)  and  D(k^ARHS) 
for  any  k=even  period  formulation. 

QED  (Property  IV) 

Note  that  when  s=b  and  P=i,  problems  P(^ADetnand)  and  P(^ARHS)  are  identical. 
In  this  case  the  results  of  both  sections  B  and  C  apply. 


D.  AN  LPoo  WITH  EXPONENTIAL  GROWTH 

This  section  describes  a  modification  to  the  K=^A  problem  (herewith  defined  as 
PA/)  by  introducing  a  limited  exponential  growth  (y>1.0  and  o,y<l)  of  the  right  hand  side 
starting  with  period;+7  where  2<j+l^-l.  The  problem  P(pA;)  has  the  following  structure: 

oo 

Minimize  ^  acx^ 
i  =  0 

Subject  to: 


Axq 

>s 

(0) 

^Axg 

+AXj 

>b 

(1) 

^Axj  +Ax2 

>b 

(2) 

^Axj_j  +Axj 

>b 

U) 

^Axj 

+AXj  ^  j 

IV 

U+1) 

^Ax.^i  +AXj^2 

>y^b  (7+2) 

Xf>0,  (i=0,l,2,...) . 
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The  associated  dual  is  D(^Aj): 


J  • 

Maximize  UqS  +  ^  u.b  +  '^  J  ^u-b 
i  =  i  i  =  j  +  l 

Subject  to: 


UqA+  Uj^A 

+  V 

=  c  (0) 

UjA+  U2^A 

=  ac  (i) 

U2A+  MjPA 

+  V2I 

=  ac  (2) 

1 

+ 

«^pA 

=  (k-1) 

Uf>0,  v.>0,  (i=0,l,2,...) . 

The  growth  factor  y  is  limited  to  l<y<l/a  to  ensure  convergence  of  the  objective 
function,  and  0<p<l .  To  establish  strong  and  weak  duality  hold  (Romeijn,  Smith,  and  Bean 
(1992)),  A>0,  c>0,  are  also  imposed. 

Property  V:  For  any  finite  k  period  {k  even)  truncation  of  P(PA7),  defined  as 
P{k^Aj),  if  Vo  >  ap^V; ,  and  j^-1,  there  exists  an  optimal  set  of  decision  variables  { }  , 

{«*}  ,  and  {v*}  (primal,  dual,  and  dual  slack  variables  respectively)  of  the  form: 


L  n  =  0 


n  =  0 


(2<i<j); 


=  (P^o  +  ^;)Y  S  ^  p” 

v„  =  0 


+  ( (-i)'^p'^)xj  (l<r^-(J+l)); 
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(k-2) 

2 

Uq  -  ^0  S 

n  =  0 

k-  (i  +  l) 

ttf  =  Uja~^  X  M)"(«P)” 

n=0 


f  i.k-4)  > 

(  (k-4)  ^ 

2 

2 

;+(a|3)"  X 

V  “  =  ^ 

^  »  =  0  j 

V*  =  a  ^Vj  (l<i^-l). 

WhereK^,,  iij,  Xq,Xj,  Vq,  Vj  ,  are  the  associated  optimal  solutions  to  the  two  period  trun¬ 
cated  problems: 

P(2^Aj)  (Two  period  Truncated  Primal) 

Minimize  cXq  +  acx j 

Subject  to: 

AXq 

+  AXj  >  b 
Xq,  Xj  >  0;  and 

D(2^Aj)  (Two  period  Truncated  Dual) 

Maximize  UqS  +  Ujb 
Subject  to: 

UqA  +  Uj^A  +  VqI  =  c 

UjA  +VjI  =  ac 

Uq,Uj,  Vq,Vj>0. 


Proof:  Along  with  primal  and  dual  feasibility,  the  optimal  solution  sets  for  P(2^Aj) 
and  D{2^Aj)  also  satisfy  complementary  slackness.  That  is: 


64 


Uq(Axq-s)  =  0-, 

Uj(^AxQ  +  Axj-b)  =  0; 

VqXo  =  0-, 

VjXj  =  0. 

The  proof  shows  that  the  solution  structure  presented  above  satisfies  (1)  primal  feasibility, 
(2)  complementary  slackness,  and  (3)  dual  feasibility  (KKT  requirements  for  optimality). 
First  let’s  define  the  arbitrary  k=even  period  primal  and  dual  problem  structures  of  inter¬ 
est; 

P(k^Aj) 

k-l 

Minimize  ^  ct"<rjc„ 

n  =  0 

Subject  to: 


AXq 

>S 

(0) 

^AXq  -^Axj 

>b 

(1) 

^AXj  ’\-Ax2 

>b 

(2) 

■\-Axj 

>b 

O') 

^Axj 

+AXj^j 

>yb 

U+i) 

+AXj^2 

Al 

(j+2) 

(k-i) 

Xj>0  0<i<k-l). 
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Dimi) 


j  k-l 

Maximize  UqS  +  ^  u^b  +  ^  Y 

n  =  1  n= j  +  1 

Subject  to: 


UqA+  Uj^A 

+  V0I 

=  c 

UjA+  U2^A 

=  ac 

U2A+  MjPA 

+  V 

2 

=  a  c 

1 

il 

II 

1 

>  0  (0  <n<k-l) . 

(1)  Show  primal  feasibility  holds,  i.e.,  show  that  the  constraints  of  P(A:pA)  are  satisfied. 


x/^>0 

(i<i^-iy, 

(20) 

AXq'^\ 

(21) 

PAXj.y^+Ax,-^^ 

(l<i^-l). 

(22) 

Given  primal  feasibility  satisfied  for  P(2^Aj)‘. 

Xo>0\ 

Xj>0\ 

Axq>s; 

+ >b. 

Equations  (20),  (21),  and  (22)  hold  for  0<i<j  since  the  primal  variables  have  the  same 
form  as  the  problem  P(A:|3A).  In  order  to  prove  non-negativity  and  that  equation  (22)  holds 
for  i>j,  we  first  need  the  following  lemma. 

Lemma:  Given  the  above  definition  for  an  optimal  primal  variable  set,  then: 

^xl,+x';  =  (Px,-hX;)  (l<i<j)  ;  (23) 
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=  y"(pXo  +  x,)  (l<r<(k-l)-i) .  (24) 

Proof.  Lets  examine  equation  (23)  first.  Substituting 


r 

k  ^ 

jj,-  = 

-  « =  0 


(-1)  "P"  +  XoP  X  (■“^)  ”P"  the  fact  that  x]  =  x,,  we  note 


thatpxj  +  jc*  =  ^Xj  +  x]  =  pX;+JC;(7-P)  +Xo^  =  +i; .  Similarly,  for  (5 


substituting  or*  =  Xj^  (-^)"P"  +  ^oPZ  (“■^)”P"  (^-i-j) 


pxf./  =  P  U/Z  M)"P"+-^oPX  (-^)"P"  ,  which  is  equal  to 


^4  S  (--^)"P"  +j^oP[  (-^)  X  (-7)"P"J,  we  also  obtain  that 


P;c;_;  +  ;c‘  =  (pJ^<,  +  ^/) 

To  prove  equation  (24),  we  need 


Pa:;„.,  =  (Pi.+ijyf  2  f2<!<t-0+/«,both 

«  =  0 

of  which  are  derived  directly  from  the  hypothesis.  Adding  these  two  equations  together 
gives  us 

=  (p*,-^i,)Tx  rfi  (-;)"7‘"'’-"P"l+( '£  (-i)-Y‘"”-p"'J  • 


r  ^  J 

Noting  that  X  (-7) ""P"^^  =  (-1)  X  (-7)  "y^"'^’""P",  and  substituting  this 


into  the  above  equation,  we  obtain 

^x]^r-i+x]^r  =  (P-^o  +  ^;)Y(y'"')  =  (P^0  +  -^/)Y' 


QED  (Lemma) 
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Given  ;r;.,  =  (P*„+*,)r(l  ""P’)  +  (  M)'PV;  (I<lA-(}+I)) .Wt 

/I  =  0 

first  prove  that  >  0  (l<r<(k-l)-j)  by  induction. 

(a)  x]^,>0.  From  our  lemma,  ^x]+x]^i  =  ( pXo  +  X;)  Y  •  This  implies  that 

x)^j  =  ( pJC(,  +  JC;)Y-Pxy.  Now  note  from  equation  (23)  that  =  (Px^  +  X;)  , 

which  implies  that  x*  =  (P^q  +  .X;)  -  Pa:*./  or  that  Px*  =  P  (P.^^  +  X;)  -  ^  Xj-i.  Sub¬ 
stituting  this  back  one  obtains 

x]^,=  (pj^o  +  ^/)y-P^!  =  (pJro  +  ^/)Y- (P(P^o  +  ^/) -P'^5-/) -Note  that  the 
right  hand  side  of  this  expression  is  equivalent  to 

(Y-P)  (pXo  +  JC;)  +^^x].,>0(as  (Y>P)anc?  (P^a;;./ > 0)  )•  Therefore,  > 0. 


(b)  Given  that  x]^,  >  0  (l<r^<k-(j+l)) ,  show  that  +  y  >0.  Note  that  from  our 
lemma  Pa:5,„  +  jc*„„,;  =  i^Xo  +  x,)y'""'  md^x%„.,+x%^  =  (pXo  +  x,)Y'”  which 
implies  that  pxj^^  =  p  (pJc^  +  X;)  y”'  -  Therefore 

x"^„.^i  =  (pjeo  +  ^/)Y'"^'- (P(P^o  +  ^/)Y'”-P'^5+-«-/)  or 

x%^,,  =  (Y-P)  ((pJCo  +  JC;)Y'”)  +^'x),„,.,>0(as  (Y>p)  and  (p'x*.,„_,  >  0) ). 
Therefore  non-negativity  (equation  (20))  is  satisfied.  To  prove  equation  (22)  holds,  we 
again  use  the  result  of  our  lemma.  From  equation  (22),  we  need  to  show  that 

PAx‘.._, ay''*.  However,  since  Pjc*.,_, =  {P^,  +  x,)y',  then 

PAnr*„.,+Ax*„  =  A  ( (Pf.+x,)/)  =  (PAf„  +  Ax, )/>/*. 

Primal  feasibility  has  been  shown. 

(2)  Show  that  complementary  slackness  holds  between  the  optimal  primal  and  dual  vari¬ 
ables  for  P{k^Aj)  and  D(k^Af),  i.e.,  show  that: 

tt*  (Axq  -s)  =  0;  (25) 
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(  Pa4_  ^+Axl-b)  =0  (l<i^-l) ;  (26) 


vfjcf  =  0  (0<i^-l). 


(Note:  This  complementary  slackness  proof  is  very  similar  to  the  proof  for  problem 
P(PA).) 

Given  complementary  slackness  between  the  optimal  primal  and  dual  variables  for 
P(2^Aj)  and  D(2^Aj): 

Uq(Axq-s)  =  0-, 

Uji^Axg  +  Axj-b)  =0; 

Vo  = 

VjXj  =  0. 

{k-2)/2  ^ 

Substituting  Uq  =  Uq  ^  (ap)  and  Xq  =  Xq  (both  from  hypothesis),  Equation 


(25)  is  equivalent  to  multiplying  Uq  (AJc^  -  ^ )  by  a  scaler  value.  Therefore  equation  (25) 


k-a+i) 


holds.  Substituting  =  m  J  a"  x  X  (-^)  («P)  j  (l^i^-1)  (hypothesis),  and 

recognizing  that  PAJc^  +  Ax j  =  ( PAj(r*_  j  +  Ax. )  ,  (for  i<j),  and  that 

^Ax]^,_,-\-Ax]^,  =  y'(PAJCo  +  AJC;)  ,  (/or  7<r<(A:-i>;)  (from  primal  feasibility  results), 
equation  (26)  (l<i^-l )  is  equivalent  to  multiplying  u  j  ( pAx^,  +  Axj-b)  =  0  by  a 
scaler.  Therefore  equation  (26)  (l<i^-l)  holds.  Equation  (27)  is  shown  to  hold  by  exam¬ 
ining  the  equation  in  terms  of  Vq,  Vj,Xq,Xi,  and  using  the  requirement  that  Vg  >  aP  Vj. 
Examining  VoX*,  the  following  equivalent  relationship  holds: 


vUo  =  vjjc,  =  i+  (aP)^  I  (aP)^"  -v^  aP  I  (aP)  -Note that 
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VoJCo  =  0  as  complementary  slackness  holds  for  the  two  period  problem.  In  addition 
0  <  <VoXo  =  0,  since  v^,  Vj,  Xo>0  ,  ap2>  0,  and  Vo  >  ap^V; .  Therefore 

VjXg  =  0.  Substituting  both  these  equivalent  relations  into  the  above  equation  it  is  clear 

that  v^xl  =  0.  Showing  v]x]  =  0  is  trivial  since  Xj  =  x,  and  v]  =  v^.  Therefore 
v]x)  =  VjX,  =  O.Toshowvfxf  =  0  ,  we  need  =  0 .  Substituting 

4  =  kX  M)"P"  +  ^oPX  {-l)T'\(2<i<j)  ,or 

^  n-0  n^O 

=  (P*.  +  *,)y(  I  (-Y)'y‘"'”"P")+  ((-')T)^; 

^  n-0 

V*  =  a  '^V;  f2<i^-i),weobtain 


v‘x,‘  =  a'-'M;Z  (-;)"r +  «'■'!> APS  M)"PV2a<j).or 


(7<r^-0+i;j.  Recog- 

n  =  0 

nizing  V;JC;  =  0  and  V;JCo  =  0,  and  that  both  of  the  above  equations  are  of  the  form 

(fVjXg  +  XvjX,  ftp  aiid  X  scalars) ,  this  leads  to  vfxf  =  0  (2<i^-l) .  Complementary 
slackness  is  satisfied  for  all  k=even  period  truncated  problems. 


k  j  +  r- } ^ 

Vj^rXj^r  =  « 


(3)  Show  dual  feasibility  holds,  i.e.,  show  that  the  constraints  of  D{kf!)Aj)  are  satisfied: 
u._ lA  +  ttf pA  +  vf_ j-a~^c  =  0  (l<i^-l) ;  (28) 

ul,A^vl,I-a’^-^c  =  0.  (29) 
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Given  dual  feasibility  is  satisfied  for  D{2^Ai): 

UqA +Ui^A  +  VqI -c  =  0; 

UjA  +V  jI-QLC  =  0. 

(Note;  This  is  identical  to  the  proof  for  problem  P(pA).) 

{k-2)/2 

Examining  equation  (2Sj  when  i=7,  substituting  =  Uq  ^  (otp)  (hypothesis) 

H  =  0 


(fc-2) 


andMy  =  M;  (-7)”(a|3)  (hypothesis),  we  get  the  following  reformulation: 


ttoA+M;pA-c+ (MoA  +  M/pA)!  X  (aP)'”  X  +v\l  =  0 


Note  that  UqA  +  w^pA  -c  =  -VqI  {D{2^A])  first  constraint).  Substituting  the  equations 
c-VqI  =  UqA  +  Uj^A  ,andac-v^/  =  UjA  (a  rearrangement  of  the  constraints  for 
D(2PA7)),  we  discover  that  the  above  equation  reduces  to: 

k-2  k-4 

2  2 

n=0  n=0 

Since  v^q  ^^^t  be  greater  than  or  equal  to  zero,  we  can  derive  a  relationship  that  must  hold 
for  any  k=even  between  and  v 

k-2  k-4 

n  =  0  n  =  0 

Note  that  for  all  (k=even),  if  >  v^ap^  (hypothesis),  the  above  equation  holds.  There¬ 
fore,  equation  (28),  when  i=l,  is  feasible  for  all  k=even.  Equation  (28),  (l<i^-l),  can  be 

shown  to  hold  by  substituting  =  «;la‘  X  (-'^)"(otP)"J> 
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/  A:-(i+7)  \ 

wf  =  u\  a'"^  X  Y,  (“■^) "  ”  ]  (hypothesis).  Substituting  the  above  into  equation 


(28)  provides  the  equivalent  expression 


-  ^  k-i 

UjA  a~^  1+  ( (ap)”- (ap)")  +v*_^/-a'‘^c  which  is  equivalent  to: 

L  V  „  =  7  /  J 


i~2  ^  A  k  r 

a  KyA  +  v,_;/-a  c 


(30) 


k  i-2^ 

Noting  that  UjA  +  Vjl  =  ac  (D(2^Aj)  second  constraint)  and  letting  v._j  =  a  v; 
(l<i<k-l)  (from  hypothesis),  substituting  these  relationships  into  equation  (30),  one 
obtains  a  (UjA  +  Vjl  -  ac)  .  Equation  (28)  (l<i^-l)  is  equivalent  to  multiplying  the 

second  constraint  of  D(2^Aj)  by  a  scaler.  Therefore,  equation  (28)  holds  above  for  all 
k=even  period  problems. 

Equation  (29)  holds  when  ;  =  a~^ui  (hypothesis),  A  +  v^/  =  ac  (D(2^Aj) 
second  constraint),  and  v,^_j  =  (hypothesis)  is  substituted  into  the  equation. 


Equation  (29)  is  then  equivalent  to: 


^  k-2  .  k  _  k-l 

Uja  A  +  Vj^_jI-a  c 


k-2 

a 


UjA  + 


k-2 

a 


Which  is  equal  to  a*  ^  (UjA  +  v^Z-ac)  =  0 .  Under  the  hypothesis.  Equation  (29)  is 

equivalent  to  multiplying  the  second  constraint  of  Z)(2pA)  by  a  scalar.  Therefore,  dual  fea¬ 
sibility  (equations  (28)  and  (29))  is  satisfied.The  hypothesis  variable  sets  satisfy  KKT  con¬ 
ditions  for  P(k^Aj)  and  ^(^PAy)  for  any  k=even  period  formulation. 

QED  {Property  V) 
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E.  P(|3A)  AND  K=pA7  RELATED  TO  PRIMAL/DUAL  EQUILIBRIUM 

The  problem  structures  examined  all  have  the  property  of  satisfying  strong  and 
weak  duality  in  the  limit  (Romeijn,  Bean,  and  Smith  1992),  and  that  any  convergent  subse¬ 
quence  of  the  optimal  decision  variables  (primal  and  dual)  converge  to  an  infinite  optimal 
solution.  This  allows  the  examination  of  the  dual  multipliers  for  the  K=^A  and  K=^Aj  stair¬ 
case  truncated  linear  programs  (the  number  of  periods  k  even)  as  the  number  of  periods  k 

goes  to  infinity.  As  shown  below,  the  dual  multipliers  converge  iou.  =  a  \j,  i.e. ,  dual 


equilibrium  is  satisfied  from  period  one  onward  for  the  infinite-horizon  linear  program 
(Grinold,  (1983b)).  Additionally,  we  verify  that  for  ^:=pA  when  P<1,  primal  equilibrium  is 
satisfied  in  the  limit. 

Model  K=^A,  p=l: 


Uq  =  Uq 


r(k-2)/2  \ 

2n 

^  « =0  ^ 


k  ^ 
u,  =  u 


f  fc-(i  +  y) 

(/-/) 
a 


V 


X. 

(-1)  a 

n  =  0  ^ 


As  k  —>00: 


Uq-^Uq 


1 


U  1  — >  M  .1  -z - 

^  ^Vi  +  a 


1  -a 
1 


=  Uj\ 


and 


It  is  clear  by  substitution  that  «,•  =  a'  'ui .  Therefore,  dual  equilibrium  conditions 


are  satisfied  (Grinold  (1983b)). 
Model  ii:=pA,)3<7: 


{k-2) 

2 

ul  =  Uq  2 

n  =  0 

k- (i  +  1) 

n  =  0 

A  =  I  M)”P"+*(,P  I  (-■')"P"  (2sa-i)- 

n  =  0  n  =  0 

As  k  -4  <»: 

,  k  ^  i-lf  1  ^  ~ 

andB,^«,(X 

As  k,  -4  00 : 

(for  any  r=l,2,...,k) 

It  is  clear  by  substitution  that  u.  =  a~^Uj,  and  that  x-  converges  in  the  limit  to 

X  for  all  i.  Therefore,  dual  equilibrium  conditions  are  satisfied  and  primal  equilibrium  con¬ 
ditions  are  satisfied  in  the  limit  (Grinold  (1983b)). 


74 


Model  K=^Aj,  with  0<a<i,  P<7, 7>1  and  a'^<l: 


k 

Xq  = 


Xj  = 

r  i-l 
k 

Xi  = 


i-2 


hi  (-/)T+i,|3S  W)T 

L  n  =  0  n  =  0 

fr-l 


=  (P^o  +  x^)Y 


(2<i<j)-, 


X  ”p”  +  (l<r^-(j+l))-, 

V»  =  o  y 


{k-2) 

2 


“o  =  “o  S 

n  =  0 

k- (i  +  1) 

u.  =  uja~^  ^  (-i)"(ap)"  (l<i^-l); 

n=0 


^0  =  ^0 


ik-4) 

2 

2  2n 


i+(ap)  2  (ap) 

n  =  0 


V 


{k-4) 

2 

(ap^)  Y, 

n  =  0 


V*  =  a  ^Vj  (l<i^-l). 


As  k  — ^ 


Uq^Uq 


i-(aP) 


5  l““o’ 


k  ^  I  1 
u,  — >  a, 


k  ^  i-H  1 


It  is  clear  by  substitution  that  u.  =  a  ^Uj .  Dual  equilibrium  conditions  are  satis¬ 
fied  (Grinold  (1983b)). 
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F.  SUMMARY 


The  following  summarizes  the  key  results  of  this  chapter; 

•The  structure  with  |3=7,  satisfies  dual  equilibrium  from  period  one 
onward,  as  u.  =  a~^Uj  (i>i).  However,  primal  equilibrium  (using  restric¬ 
tions  X(=X(+])  is  never  satisfied  as  the  optimal  primal  sequence  is  cyclic,  with 
periodicity  two.  Primal  restrictions  of  the  form  Xt=x^+2  allows  primal  equilib¬ 
rium  to  collapse  to  an  infinite-horizon  optimal. 

•The  K=^  staircase  structure  with  P<7  and  the  K=^Aj  structure  satisfies  dual 
equilibrium  from  period  one  onward,  as  u.  =  a  (i>l). 

It  is  also  important  to  note  that  for  these  particular  problem  structures,  solving  the 
two  period  truncated  solution  provides  all  the  information  needed  to  derive  an  optimal  so¬ 
lution  sequence  {x,  }  to  the  infinite-horizon  formulation. 

If  a  problem  of  interest  satisfies  any  of  the  problem  structures  defined  in  this  chap¬ 
ter,  or  is  an  example  of  other  specific  problem  structures  for  which  the  form  of  the  infinite- 
horizon  solution  can  be  found  (c.g.,  Grinold  and  Hopkins  (1973a)),  then  the  infinite-hori¬ 
zon  optimal  solution  can  be  solved  for  directly.  However,  in  general,  for  most  practical 
problems,  it  is  difficult  to  ascertain  enough  information  regarding  the  form  of  the  infinite 
optimal  solution,  to  use  direct  methods.  Therefore,  a  bounding  approximation  is  needed  for 
most  real-world  applications.  The  next  chapter  explores  the  properties  associated  with  pri¬ 
mal  and  dual  equilibrium  approximations,  and  confirms  that  these  methods  generate  valid 
bounds  over  a  large  class  of  potential  problem  structures. 
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IV.  CONVERGENCE  PROPERTIES  OF  PRIMAL,  DUAL 
EQUILIBRIUM,  AND  TRUNCATION  APPROXIMATION 

METHODS 

Svoronos  (1985)  first  introduced  the  notion  of  using  primal  and  dual  equilibrium 
approximations  to  establish  an  approximate  value  for  the  optimal  objeetive  value  for  a  gen¬ 
eral  class  to  infinite-horizon  convex  programs.  This  chapter  shows  that  when  appropriately 
defined,  primal  and  dual  equilibrium  approximations  generate  upper  and  lower  bounds  re¬ 
spectively  for  both  LP°°,  and  for  infinite-horizon  integer  and  mixed  integer  programs 
(A//Po°).  Sections  A  introduces  notation  for  this  chapter.  Sections  B  and  C  prove  the  primal 
and  dual  equilibrium  optimal  objective  function  values,  when  properly  established,  always 
bound  the  infinite-horizon  optimal  objective  function  value.  Section  C  also  establishes  that 
convergence  of  the  truncated  optimal  objective  function  value  to  the  infinite  optimal  solu¬ 
tion  implies  the  optimal  objective  function  value  for  the  dual  equilibrium  approximation 
converges  to  the  infinite  optimal  solution.  Section  D  provides  an  illustrative  example, 
where  both  truncated  and  dual  equilibrium  approximations  converge  to  the  infinite  optimal, 
however,  a  duality  overlap  exists.  Section  E  discusses  how  these  results  may  be  used  in 
practice. 

A.  NOTATION 

This  section  uses  the  following  mathematical  notation  where,  unless  stated  other¬ 
wise,  holds  for  both  LPoo  and  MIPoo: 

oo 

OO  ^ 

jr°  The  feasible  region  for  the  infinite-horizon  formulation,  X 

t  =  0 


11 


The  feasible  region  for  a  T  period  truncated  approximation  of  the  infinite- 

oo 

oo  /I 

horizon  formulation,  Xj  c  n 

t  =  o 

Xpj^  The  feasible  region  for  a  T  period  primal  equilibrium  approximation  of  the 

oo 

infinite-horizon  formulation,  with  cuts  of  the  form  Xpj  c  PJ[  R  , 

t  =  o 

Xdj"  The  feasible  region  for  a  T  period  dual  equilibrium  approximation  of  the  in¬ 
finite-horizon  formulation,  where  all  constraints  containing  the  decision  variables  {t>T) 

oo 

oo  ^ 

are  aggregated  using  an  a  discount  factor,  XdjC  ns"'"; 

t  =  o 

V°°  The  optimal  objective  function  value  for  the  infinite-horizon  formulation; 

Vx"  The  optimal  objective  function  value  for  the  T period  truncated  approxima¬ 

tion; 

Vpx"  The  optimal  objective  function  value  for  the  T period  primal  equilibrium  ap¬ 
proximation; 

Vd/"  The  optimal  objective  function  value  for  the  T  period  dual  equilibrium  ap¬ 
proximation; 

Vp"  The  value  of  the  limf^^Vp  t  when  it  exists; 

Vd°°  The  value  of  the  linij  ^^Vd°°T  when  it  exists; 

X  An  infinite  sequence  of  decision  variables  {xj}  that  is  feasible  to  the  infinite- 

horizon  formulation  (i.e.,  xe  X°°); 

Xf  An  infinite  sequence  of  decision  variables  {Xj}  that  is  feasible  to  the  trun¬ 
cated  formulation  (i.e.,  Xj-e  Xj-  ); 
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xpj  An  infinite  sequence  of  decision  variables  {xj  that  is  feasible  to  the  primal 

equilibrium  approximation  {i.e.,xpj&  Xpj°°)', 

xdj  An  infinite  sequence  of  decision  variables  {aTj}  that  is  feasible  to  the  dual 

equilibrium  approximation  {Le.,  xdj&  Xd-f). 

B.  PROPERTIES  OF  PRIMAL  EQUILIBRIUM  APPROXIMATIONS 

The  relationship  between  a  primal  equilibrium  approximation  and  its  infinite-hori¬ 
zon  formulation: 

Given  any  infinite-horizon  formulation  (restricted  in  this  case  to  LP°°  or  MIP°°), 

primal  equilibrium  approximations  are  additional  restrictions  placed  on  X°° ,  start¬ 
ing  at  some  finite  period  T,  that  result  in  a  finite  period  equivalent  formulation  of  the 
problem,  with  a  non-empty  feasible  region. 

This  is  a  slightly  more  general  definition  than  that  of  Manne  (1970)  presented  in 
Chapter  11.  The  defining  restrictions  limit  choices  to  those  that  maintain  primal  feasibility 
and  allow  for  the  constraints  in  the  original  formulation  to  eventually  become  redundant, 
by  creating  a  functional  tie  between  a  finite  set  of  decision  variables  and  the  rest  of  the  vari¬ 
ables  in  the  sequence.  This  allows  primal  equilibrium  approximations  to  be  solved  as 
equivalent  finite  period  formulations.  For  the  lower  triangular  structured  LP«>  presented 
in  Section  A.l.g  of  Chapter  II,  restrictions  of  the  formx:t=Aa:t+i  are  viable.  However,  when 
X=l,  restrictions  of  the  form  Xf=X(+i^  (k  finite)  are  viable  for  both  LP°°,  and  when  the  for¬ 
mulation  is  restricted  to  integer,  i.e.,  MIP°°. 

Given  this  defining  relationship  between  the  original  infinite-horizon  formulation 
and  the  primal  equilibrium  approximation,  it  is  possible  to  establish  several  general  rela¬ 
tionships  relating  the  optimal  value  of  the  primal  equilibrium  approximation  to  the  optimal 
value  of  the  infinite-horizon  optimal  solution. 
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For  the  remainder  of  this  section  the  following  assumptions  hold: 

•The  infinite-horizon  problem  of  interest  is  to  minimize  a  linear  objective 
function,  over  a  defined  and  non-empty  feasible  region. 

•Restrictions  can  be  identified  that  generate  non-empty  feasible  regions  and 
finite  period  re-formulations  with  finite  optimal  objective  function  values. 

•A  finite  optimal  exists  for  the  infinite-horizon  problem. 

1.  Monotonic  Behavior  of  the  Primal  Equilibrium  Approximation 
Objective  Value 

Property  VI:  The  optimal  objective  function  value  for  the  primal  equilibrium  ap¬ 
proximation  is  monotonic  and  non-increasing  with  increasing  T. 

It  is  clear  that  Xp'^  c  Xp^^ , ,  since  Xp°j=Xp°j^in  {Vr  =  Xr+z.}  (i-e.,  X  e  Xp^ 

implies  x  e  Xp°j.^,).  Let  xpr  be  any  optimal  solution  with  objective  function  value  Vpj 

to  Xpt  .  The  objective  function  value  Vpj  provides  an  upper  bound  on  the  optimal  objec- 

five  function  value  Vpr+ z  determined  over  the  feasible  region  Xp°^^ , ,  since  xpr  e  Xpj+ , . 

Therefore,  the  optimal  objective  value  Vpj  is  monotonically  non-increasing  with  increas- 

OO  OO 

\ngT,i.e.,Vpj.  >Vpj^j  . 

QED  {Property  VI) 

2.  Relationship  Between  the  Primal  Equilibrium  Approximation 
and  the  Infinite-Horizon  Optimal  Objective  Function  Value 

Property  VII:  The  optimal  objective  function  value  for  the  primal  equilibrium  ap¬ 
proximation  generates  an  upper  bound  for  the  optimal  objective  function  value  for  the  in¬ 
finite-horizon  problem. 

For  any  T,  given  xpj^  Xp°j- ,  then  xpj-G  X  as  by  definition 
Xp’j.=X°°n  {x,  =  \/t>T}  .  Therefore,  since  xpr  e  X°° ,  it’s  associated  objective 
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function  value  Vp^  >  V” .  Assume  further  that  there  exists  a  T  such  that  Vp-r  is  finite.  In 

this  case,  the  limit  of  Vp^ ,  defined  as  Vp’^  exists,  and  Vpj>Vp°l^ j > Vp°° >  V  . 

QED  {Property  VIP) 

3.  Convergence  Properties  of  Primal  Equilibrium  Approximation 

There  are  relatively  few  assumptions  required  to  show  both  Vpf  and  Vp°°  exist 

and  bound  V°°  from  above.  However,  the  conditions  under  which  Vp°°=V°°  are  problem 
specific  and  more  difficult  to  in  general  to  verify.  Manne  (1970),  and  Svoronos  (1985)  de¬ 
velop  problem  structures  that  ensure  when  primal  equilibrium  restrictions  are  used,  the  ob¬ 
jective  function  value  and  a  subsequence  of  decision  variables  converge  to  an  infinite- 
horizon  optimal.  Verifying  convergence  is  highly  dependent  on  both  problem  structure,  and 
on  the  choice  of  restriction.  This  is  illustrated  with  the  following  example: 

Minimize  X2 
Subject  to: 

Xj  +X2  =  1 

X2  +-*^5  =  7 

Xi>0 

Given  any  T,  the  primal  restriction  A!:t=JCt+i  for  all  t>T,  leads  to  an  optimal  solution 

of  Vp°°=VPt’^=0.5,  and  the  optimal  solution  sequence  {0.5, 0.5, 0.5,...}.  It  is  clear  by  in¬ 
spection  however,  that  the  minimum  possible  solution  is  X2=0,  and  that  the  sequence 
{ 1,0, 1,0, 1,0...}  is  a  feasible  sequence  with  01:2  and  the  optimal  objective  function  equal  to 
0.0.  If  the  primal  restriction  is  used  for  any  T>1,  the  resulting  feasible  region 

still  includes  the  optimal  sequence  { 1,0, 1,0, 1,0...}.,  resulting  in  Vp  =VPt  =V  =0.0. 
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Verifying  convergence  of  primal  equilibrium  approximations  to  the  infinite-hori¬ 
zon  optimal,  using  any  restriction  is  non-trivial.  However,  given  the  restriction  generates  a 

non-empty  feasible  region,  the  solution  V/?/  is  an  upper  bound  for  y“  ,  and  its  associated 
decisions  xpr^  X°° .  This  allows  for  practical  implementation  of  primal  equilibrium  as  a 
method  to  generate  a  sequence  of  non-increasing  upper  bounds  for  F”  . 

C.  PROPERTIES  OF  DUAL  EQUILIBRIUM  APPROXIMATIONS 

The  relationship  between  the  dual  equilibrium  approximation  and  the  original  infi¬ 
nite-horizon  formulation: 

Given  any  infinite-horizon  formulation  (LP°°  orMIP°°),  where  the  constraint 
space  is  lower  triangular  in  nature,  the  dual  equilibrium  approximation  are  relax¬ 
ations  over  X^.  This  relaxation  takes  the  form  of  aggregating  all  constraints  that  in¬ 
clude  Xp  for  all  t>T,  (T  some  fixed  integer  value)  using  a  discount  factor  a,  to  form 

one  constraint.  The  aggregation  allows  the  variable  Xp=  X  and  for  the  infinite 

t  =  T 

constraint  space  to  be  collapsed  such  that  an  equivalent  finite  period  formulation  ex¬ 
ists. 


Chapter  II  provides  a  detailed  discussion  of  dual  equilibrium  approximation  as  ap¬ 
plied  to  LPoo,  however  the  point  is  that  the  dual  feasible  region  derived,  Xdf  □  A”  for  all 

T.  When  is  the  feasible  region  of  a  MIP«>  formulation,  the  relaxation  can  involve  not 
only  aggregating  the  constraint  space,  but  also  relaxing  the  integrality  of  the  decision  vari¬ 
ables. 

For  the  remainder  of  this  section,  the  following  assumptions  hold: 

•The  infinite-horizon  problem  of  interest  is  to  minimize  a  linear  objective 
function  over  a  defined  non-empty  region. 
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•A  finite  optimal  solution  exists  for  the  infinite-horizon  problem. 

•For  some  T,  (I  finite)  a  finite  optimal  solution  exists  over  the  dual  feasible 
region  Xdj°° . 

1.  Monotonic  Behavior  of  the  Dual  Equilibrium  Approximation 
Objective  Value 

Property  VIII:  The  optimal  objective  function  value  for  the  dual  equilibrium  ap¬ 
proximation  is  monotonic  and  non-decreasing  with  increasing  T. 

This  is  obtained  directly  be  realizing  that  Xdf°  3  Xd°°T+i-  Therefore, 

X  e  Xd°°T+i  =^x  e  Xrf“r  -  Then  any  optimal  solution  xdr+i  to  the  T+1  period  dual  equi¬ 
librium  formulation,  is  a  feasible  point  for  the  T  period  dual  equilibrium  relaxation.  This 

implies  that  Vd°°T+i  is  an  upper  bound  for  Vd  r  •  Therefore,  the  optimal  objective  function 

value  is  a  non-decreasing  sequence  with  increasing  T,  i.e.,  Vd  r^Vd  t+i  for  all  T. 

QED  {Property  VIII) 

2.  Relationship  Between  the  Dual  Equilibrium  Approximation  and 
the  Infinite-Horizon  Optimal  Objective  Function  Value 

Property  IX:  The  optimal  objective  function  value  for  the  dual  equilibrium  approx¬ 
imation  generates  a  lower  bound  for  the  optimal  objective  function. 

This  again  comes  directly  from  the  definition  of  dual  equilibrium.  By  definition, 

Xdf°  3  X°°  for  all  T.  This  linked  with  our  previous  result  leads  to  ZJj."  3  Xd°°T+i  3  Z 
for  all  T.  Since  any  x  e  Z“  =>  v  e  Xd°°T^i  =>  v  e  Xd°° t  ,  any  optimal  x  to  X°°  with  objec¬ 
tive  value  V“,  is  and  upper  bound  for  the  value  ofVd  t+i  ^  which  is  an  upper  bound  for  the 
value  of  Vd°°T  ■  Given  that  V°°  exists  and  is  finite,  and  that  for  some  T,  a  finite  solution  exists 

Vdj°T ,  then  the  sequence  formed  by  {  is  a  monotonic,  non-decreasing  sequence  of 

real  numbers  bounded  above  by  a  finite  value,  which  implies  that  this  sequence  has  a  lim- 
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iting  value  defined  as  Vd^<V°° .  Therefore,  the  dual  equilibrium  approximation  provides  a 
non-decreasing  sequence  of  lower  bounds  with  increasing  T  for  the  optimal  objective  func¬ 
tion  value  of  the  original  primal  infinite-horizon  formulation. 

QED  {Property  IX) 

3.  Convergence  Properties  of  Dual  Equilibrium  Approximation 

As  illustrated  in  the  previous  section,  relatively  few  assumptions  are  required  to  in¬ 
sure  that  the  dual  equilibrium  formulation,  when  properly  derived,  provides  a  valid  lower 
bound  for  the  optimal  objective  function  value  for  the  infinite-horizon  formulation.  How¬ 
ever,  conditions  under  which  Vd‘°=V°°  are  more  restrictive  and  become  problem  specific 
in  nature.  Grinold  (1977, 1983b)  and  Svoronos  (1985)  have  derived  convex  infinite-hori¬ 
zon  structures  for  which  dual  equilibrium  approximation  values  (variable  and  objective 
function)  converge  in  the  limit  to  an  optimal  associated  with  the  infinite-horizon  formula¬ 
tion.  In  general  confirming  convergence  involves  verifying  that  in  the  limit,  a  subsequence 
of  the  optimal  decision  variables  derived  using  dual  equilibrium  approximations  converge 

to  some  feasible  sequence  over  X^. 

If  the  truncated  formulation  objective  function  value  is  convergent  to  the  infinite 
optimal,  then  the  dual  equilibrium  approximation  is  convergent  to  the  infinite  optimal  as 

well.  In  this  case,  by  construction  3  Xdj°° ,  (i.e.,  x  e  Xdj  ,  implies  x  e  Xj.  ).  Since 
xdj.  is  an  element  of  A/ ,  this  implies  that  Vdj”  is  an  upper  bound  for  Fr” 

{VT°°<Vd/’<V"  for  all  T).  Therefore,  if  this  implies  Vd^  V°° . 
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D.  AN  EXAMPLE  WHERE  DUAL  AND  TRUNCATED 

APPROXIMATIONS  ARE  CONVERGENT  AND  A  DUALITY 
OVERLAP  EXISTS 

Consider  the  following  example  originally  introduced  by  Grinold  and  Hopkins 
(1973b)  and  modified  by  Romeijn,  Smith,  and  Bean  (1992)  to  include  bounds  on  the  vari¬ 
ables. 

Primal  Formulation: 


Minimize  ^ 
i  =  / 


Subject  to: 

Xj  >r, 


yj+Zj>l-, 

-2yi_i+x.>0  (i=2,3,...); 
-2x._j+y^  +  Zi>0  (i=2,3,...); 

0<x^<2'~^  (i=l,2,...); 


0<y^<2"~^  (i=l,2,...y, 
0<z^<l  (i=l,2,...). 


Dual  Formulation: 


maximize 


i  =  l 


Subject  to: 


7 


u^-2v.^^-p^<0{i=l, 2, 

v.-2u._^_j-qi<0(i=l,2,...); 

It  is  a  simple  matter  to  verify  that  the  best  possible  optimal  primal  objective  is  0, 
and  that  the  following  solution  is  optimal  for  the  primal  infinite-horizon  formulation: 
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y,=r-\i=i,2,...y, 

Zi=0,  {i=l,2,...). 

Note  that  this  solution  is  an  optimal  solution  for  any  truncated  or  dual  equilibrium 
approximation  (with  period  T).  Therefore,  in  this  case  both  the  truncated  and  dual  equilib¬ 
rium  approximations  converge  to  the  infinite-horizon  optimal  solution  and  provide  a  finite 
set  of  decision  variables  that  are  part  of  an  optimal  set  to  the  infinite-horizon  primal  formu¬ 
lation. 

However,  now  examine  the  dual  infinite-horizon  formulation.  It  is  easily  shown  that 
the  following  solution  set  is  feasible  and  generates  a  optimal  objective  function  value  of  2 
for  the  dual  infinite-horizon  formulation: 

u,  =  (0'’'  (i=l,2,...)\ 

Pi=qi=ri=0(i=l,2,...). 

In  this  case  weak  duality  fails  however  both  truncated  and  dual  equilibrium  approxima¬ 
tions  provide  convergent  solutions  to  the  infinite-horizon  primal  optimal. 


E.  SUMMARY 

This  chapter  shows  that  when  properly  defined,  primal  and  dual  equilibrium  ap¬ 
proximations  bound  the  infinite-horizon  optimal  objective  function  value  for  both  LP<»  and 
MIP~.  Further,  any  primal  equilibrium  optimal  solution  is  feasible  over  the  infinite-hori¬ 
zon.  This  ability  to  bound  the  objective  function  value  of  the  primal  infinite-horizon  for¬ 
mulation,  is  key  to  quantifying  the  influence  of  any  end  effects  acting  on  the  primal  and 
dual  equilibrium  approximations.  Other  authors  have  almost  exclusively  focused  on  the  is¬ 
sue  of  convergence  (Svoronos  (1985)  for  Convex  Spaces,  Schochetman  and  Smith  (1992) 
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for  infinite  dimensional  spaces  that  include  MIP«>).  Convergence  is  a  problem  specific  is¬ 
sue,  and  cannot  be  verified  in  general.  If  the  difference  between  the  primal  and  dual  equi¬ 
librium  approximation  objective  function  values  is  small,  then  whether  or  not  the  solution 
is  convergent  to  the  infinite  optimal  is  of  little  practical  importance,  as  primal  and  dual 
equilibrium  approximations  generate  a  solution  to  the  infinite-horizon  problem  which  is 
measurably  (examining  objective  function  values)  near  optimal.  Following  chapters  exam¬ 
ine  the  effectiveness  of  primal  and  dual  equilibrium  approximations  to  both  generate  tight 
bounds  on  the  infinite  optimal  solution,  and  to  eliminate  end  effects  associated  with  trun¬ 
cated  formulations.  While  the  issues  of  weak  and  strong  duality  are  also  of  theoretical  in¬ 
terest,  our  focus  is  on  solving  or  bounding  the  infinite  optimal  solution  to  the  primal 
infinite-horizon  formulation.  Strong  and/or  weak  duality  may  or  may  not  hold:  Primal  and 
dual  equilibrium  approximations  always  bound  the  infinite-horizon  optimal  for  the  primal 
formulation. 

A  major  flaw  from  a  modeling  perspective  in  extending  truncated  formulations  over 
an  infinite-horizon,  is  the  assumption  that  the  problem  structure  over  the  infinite-horizon  is 
completely  known.  While  many  problems  subject  to  end  effects  have  indeterminate  hori¬ 
zon  lengths,  their  structure  is  not  necessarily  known.  If  this  extension  method  is  to  prove 
valid,  tests  must  be  devised  to  examine  the  variability  of  initial  period  optimal  decisions  to 
changes  in  future  period  coefficients,  that  were  not  originally  modeled  in  the  truncated  for¬ 
mulation.  The  next  chapter  focuses  on  this  issue  for  LP«>. 
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V.  DETERMINING  THE  STABILITY  OF  THE  INITIAL  DECISION 
VARIABLES  OVER  A  RANGE  OF  POSSIBLE  RIGHT  HAND  SIDE 
VALUES 

For  many  problems,  the  constraint  coefficients  associated  with  primal  decision 
variables  are  well  defined  (e.g.,  utility  coefficients  or  network  structure),  however  the  right 
hand  side  (e.g.,  projected  demand)  can  only  be  predicted  to  lie  within  some  range. 

Section  A  defines  the  optimal  objective  function  value  as  a  function  of  the  right 
hand  side.  A  linear  programming  example  illustrates  that  even  when  two  right  hand  sides 
*0  and  bi  have  the  same  initial  period  optimal  decision  variable  (x^),  this  variable  may  be 
suboptimal  for  some  ^»=((l-e)i>o  +0&i.  0<e<l).  This  section  also  proves  the  optimal  objec¬ 
tive  function  value  for  a  bounded  finite  dimensional  minimization  linear  program,  is  a 
piecewise  continuous  convex  function  over  the  convex  combination  (( 1  -B)bQ  +Qb  i ,  O<0<  1 ) . 

Sections  B  through  E  use  the  results  of  section  A  to  develop  an  algorithm  which  de¬ 
termines  if  a  specific  Xg  is  an  optimal  solution  for  all  b=  ((l-0)i>o  +0^1’  0<Q<1). 

Section  F  expands  on  the  results  of  section  E,  by  developing  an  algorithm  to  deter¬ 
mine  the  potential  worst  case  impact  of  using  Xg  for  any  b=  ((l-0)6o  +0*1,  0<Q<1).  This 
algorithm  generates  a  monotonic  non-increasing  sequence  of  upper  bounds  on  the  error, 
and  is  guaranteed  to  terminate  after  a  finite  number  of  iterations. 

Section  G  extends  the  algorithm  of  section  F  for  primal  and  dual  equilibrium  ap¬ 
proximations.  The  algorithm  still  generates  a  monotonic  non-increasing  sequence  of  upper 
bounds  on  the  error  associated  with  the  infinite-horizon  optimal  objective  function  value 
when Xo=  Xg  for  b=  ((l-0)i»o  The  only  limiting  factor  is  that  after  some  fi¬ 

nite  horizon,  elements  of  b  must  eventually  become  invariant  in  order  to  define  the  dual  and 
primal  equilibrium  approximations. 
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A.  PROBLEM  DEFINITION/PRELIMINARIES 

Consider  the  problem  LP07 : 

LP07 

hiQ)  =  minimize  cx 
Subject  to: 

Ax^  {d)bj+  {l  —  B)bQ 
x>0. 

Where  a:={xo,  Xj,X2,...Xn},a  feasible  set  of  decision  variables  for  the  right  hand  side 
(Q)bo  +  (7-0)  bj,  (O<0<7)  which  represents  some  range  of  interest.  LP07  is  assumed  to  have 
a  finite  optimal  for  all  O<0<7. 

Now  assume  that  for  0=0,  and  for  0=7,  there  exists  an  optimal 
{Xg,  Xj,  JC2,  . . . }  =  a:®  withxo=Xo .  Further,  assume  thath(d)  is  finite  over  the  range  O<0<7. 

Is  xo=Xo  part  of  an  optimal  solution  for  all  O<0<7  ?  This  is  not  assured  in  general.  Consider 

the  following  problem: 

LPEXl: 

Minimize 
Subject  to: 

-Xo  +  Xi>0 

-Xq-Xj>%{-4)  +  (7-0)  (-2) 

-2Xq  +  Xj>-1 
-2xq  -Xj>-5 

Xq,Xj>0. 

This  problem  has  the  optimal  solution  values  illustrated  graphically  by  Figure  4. 
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Figure  4. 

Behavior  of  optimal  Xq. 


To  derive  an  algorithm  which  determines  whether  jro=X(,  is  part  of  an  optimal  solution  for 
all  0<Q<1,  we  require  Theorem  1. 


Theorem  (1):  Given  h{&)  is  finite  for  0<e<7,  h{Q)  is  a  piecewise  linear  convex  function 
over  O<0<i,  continuous  over  O<0<7,  and  has  only  finitely  many  points  of  non-differentia- 
bility. 

Figure  5  illustrates  the  functional  relationship  between  ^(0)  and  0: 
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Figure  5. 

Piecewise  linear  convex  function  with  a  finite  number  of  non-differentiable  points. 
Proof. 

The  dual  formulation  of  h{Q)  is: 

^  (0)  =  maximize  tc  ( (0)  f  -  0)  bf) 

Subject  to: 
tiA  <c  ; 

K>0. 

Given  h(d)  is  finite  over  0<Q<1,  then  for  each  0,  there  exists  a  dual  extreme  point  optimal 
solution.  Also  note  that  the  dual  feasible  region  has  only  a  finite  number  of  possible 
extreme  points.  Accordingly,  the  dual  formulation  is  equivalent  to: 

h  (0)  =  {7t‘  ( (0)  bj  +  (1  -  0)  6^)  }  ^ 

where  l<i<k  are  the  extreme  points  of  the  dual  feasible  region.  Therefore,  ^(0)  is  the 
maximum  of  a  finite  number  of  linear  functions  with  respect  to  0. 

Proof  that  h{Q)  is  convex  with  respect  to  0  over  the  range  0<Q<1. 

Let  0 1  and  02  be  any  two  elements  of  the  set  [0,i].  For  any  A,  e  {0,1), 
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h{XQ^+  {1-X)Q^  =  max  j  [b  ^  +  (7-X.)02)  +1^(1-  (XG^  +  (i-A,)02))]  }  . 

The  right  hand  side  is  equivalent  to: 

max  -  (^67+  (•^-^)62))]  } 

=  max  [X(bjej+  {1-Q^)b^  +  (7 -A,)  (6762+  (7-02)V^^ 

^maxj^f^^  {Xn  (ft^Gy  +  (1  -Oj)bQ)  }  +fnaXj^.^j^  {  (1-X)  n  (*782+  ~  ^2^*0^  } 

=  lmaxj^i^^{nibjej+  (i-G^)*^,)}  +  (i-X)  {n  (fc;02  +  (7-02)V> 

=  XhiQj)  +  {1-X)h{%2)  ■ 

Therefore: 

h  (XQj  +  XQ2)  <  Xh  (Qj)  +  il-X)h  (02)  ,  and  HQ)  is  convex  with  respect  to  0. 

Proof  that  h(B)  is  continuous  with  respect  to  0,  over  the  range  0<B<1.  (A  proof  is  provided 
below.  An  alternate  proof  can  be  found  in  Rockafellar  (1970)). 

For  this  part  of  the  proof,  we  rely  on  the  fact  that  ^(0)  is  convex,  and  reference  the  follow¬ 
ing  lemma  (Royden,  (1988),  pp  113): 

Lemma:  If/is  convex  on  any  open  interval  (a,b),  and  ifx,  y,  x',  y'  are  points  of  (a,b)  with 
x^'<y',  and  x<y<y',  then  the  chord  over  {x',y')  has  larger  slope  than  the  chord  over  (x,y); 

thatis.  (/W-/W)<(/W,-/W).. 
y-x  y  -X 

We  use  this  lemma  to  prove  that  /i(0)  is  continuous  for  any  (0;,  02)  c  [0,1]  . 

Given  any  (0/,  02)  c  [0,  i]  ,  where  02>0i,  one  can  find  an x,  y,  x',  and y'  such  that 
O<x<0i<02,  O<x<y<02,  and  0i^'<y'<7,  0i<02<y'</.  From  the  lemma  we  obtain: 
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Since  ^(6)  is  defined  and  bounded  over  the  interval  [0,1],  it  is  clear  from  the  above  that 
there  exists  some  finite  number  such  that: 


-M< 


02-0; 


<M; 


or  that  [A  (02)  (6/)|  ^  • 

Now  let  5=8/M.  Then  for  any  l02-0il<8,  \h  (02)  -  (©;)  |  <  e  •  Therefore,  h{%)  is  continu¬ 


ous. 


Prove  that  the  function  h{Q)  has  only  finitely  many  points  of  intersection  (i.e.,  non-differ- 
entiable  points). 

The  following  property  is  required: 

Property  X:  Given  ^(0i)  =  7t'*((0i)6]  +  (7-0i)&o)>  ^(^2)  =  ^'*((^2)^1  (^■02)^o)> 

6)<0i<02^7,  then  ^(0)  =  7U^*((0)&i  +  (7-0)6o)  for  0i<0<02- 

Proof  of  Property  X.  There  exists  a  7t'*  that  satisfies  the  hypothesis  since  h{%)  exists  and  is 
finite  for  all  0<Q<1,  and  there  are  only  finitely  many  dual  extreme  points,  7t‘.  Now,  assume 
the  claim  is  not  true.  Then  there  exists  at  least  one  0  (0i<0<02), where  0=X.0i  +(1-A,)02 

for  some  X  (0<X<1),  and  another  extreme  point  nf  such  that 

jij[(X,9£  +(1-X)e2)6i  +  +(l-X-)92))ftol>’r'*[(X0i  +(1-X.)92)&i  +  (i-(X.9i  +(1-X,)02))fto]- 

Rearranging  both  sides  one  obtains  the  equivalent  expression: 

Uj(e,Ai+(l-9i)&o)+(l-^W(92*i+(l-92)fto)>^’r‘*(9ife,+(l-9i)&o)+(l->^W*(02*i+(l-62)*o)-  (f) 

However  note  from  the  hypothesis  that  n;**((0i)6i  +  (7-0i)fto)^'^((®l)^l  (-^'^1)^0)  since 

hiBj)  =  maxj^^K\iQi)bj+ (1 -Qj)b^)  =n  i{Qj)b (1  -Qj)b^)  .Since 

0<X<1,  this  implies  that  X-7cj*((0i)fei  +  (i-0i)7>o)-)''rt‘*((0i)^l  +  (7-0i)^o)-  Similarly, 


(l-?i)7tj((02)&l  +  (i-02)&o)^(l-^)^‘*((®2)*l  +  0-^7)h)-  Adding  both  sides  of  these  two 
equations  together  one  obtains: 

?o7lj(0,6i+(l-0i)6o)+(l-?^W(e2*l+(l-02)*o)^^"‘*(01*l+(i-®l)*o)+(l-^W*(02*l+(l-62)&o)- 
A  contradiction  with  equation  (1). 

Therefore,  given  any  two  points  0i  and  02,  for  which  Tt'*  is  an  argmax  dual  extreme  point, 

then,  7t‘*  is  an  argmax  dual  extreme  point  for  the  interval  [0^,  02]. 

QED  (PropertyX) 

Now  using  Property  X,  it  is  clear  that  given  any  two  disjoint  intervals  for  which  7t**  is  the 
max  dual  extreme  point,  i.e.,  [0],  02],  [03,  04],  where  0j<02<03<04,  that  7c'*  is  the  max 

dual  extreme  point  for  the  interval  [02,  04].  Therefore  each  7t*  is  either: 

•Not  an  max  dual  extreme  point  for  any  0  (Cl<0</). 

•An  max  dual  extreme  point  over  a  single  closed  interval  [02,  02]- 

•An  max  dual  extreme  point  over  a  single  point  0. 

Therefore,  each  max  dual  extreme  point  is  tied  to  only  one  unique  point  or  to  only  one  lin¬ 
ear  line  segment  over  the  interval.  Since  there  are  only  finitely  many  dual  extreme  points, 
there  can  only  be  finitely  many  linear  line  segments,  and  therefore  only  finitely  many 
points  of  intersection  possible  over  the  domain  of  0  {i.e.  given  k  dual  extreme  points,  a 
max  of  k-1  points  of  non-differentiability).  Therefore,  ^(0)  is  a  convex,  piecewise  linear 
function  with  only  finitely  many  points  of  non-differentiability. 

QED  {Theorem  (1)) 
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B.  EXAMINING  THE  STABILITY  OF  Xo  FOR  O<0<1 

Consider  the  linear  program  LPB2: 
z  (Zj,  Zq,  bj,  bg)  =  Minimize  cx-  (0Z;  +  (1  -B)Zq) 

Subject  to: 

Ax>  iBbj+  {1-B)b(j) 
x>0,0<Q<l; 

and  the  linear  program  LPQ3  (where  Xg  is  the  optimal  Xq  for  LP6i  with  0=0); 

hr  (Q)  =  minimize  cx 
Subject  to: 

Ax>bjiQ)  +b^(l-d) 

Xq  =  Xq 

x>0. 

Assume  thatXo=Xo  is  a  feasible  solution  for  any  O<0<i  (e.g.,  the  feasible  region  repre- 

Ir 

sented  by  Ax^j  is  a  subset  of  the  feasible  region  represented  by  Ax^q).  Define  x  as  a 

set  of  optimal  decision  variables  to  LP05  with  0=7,  and  as  a  set  of  optimal  decision 
variables  to  LP05  with  0=0.  Now  let  Zi=hr(l),  (the  optimal  objective  function  value 
obtained  from  LPQ3  with  0=7)  md  Zo=h{0)=hr(0)  (the  optimal  objective  function  value 
obtained  from  LPQl  with  0=0). 

Over  all  choices  of  0,  LP02  seeks  to  maximize  the  distance  between  the  optimal  ob¬ 
jective  function  value  of  LP07  (i.e.,  h(Q)),  and  the  convex  combination  ofZ|  andzQ-  Figure 

6  illustrates  graphically  the  optimal  solution. 
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Figure  6. 

Graphical  representation  of  an  optimal  solution  to  LP02  in  terms  of  0. 

Note  that  the  optimal  solution  occurs  at  a  point  of  intersection  for  the  continuous  piece- 
wise  linear  convex  function  h(Q)  or  at  0=/. 

Theorem  (2)  \z  {Zj,  Zo,h„  bg)  |  >^r  (0)  -h  (0)  V0 , 0<Q<1. 

Proof: 

Clearly  0x^''+(l-0):»:^'‘  generates  the  objective  function  value  of  0zi+(7-0)zo,  and 
0<<d<l  is  feasible  to  both  LP07  and  LP05  since  0Ax^''>0fti  and  {1- 
Q)Ax^’'>{l-%)bQ,  which  implies  that  A[0x^''+(l-0)jc^'']  >  Qbi+{l-Q)bQ  andar^''  and both 
contain  a:o=JCo  .  Because  LP05  is  a  restriction  of  LP0i  we  have  /i(0)^r(0).  By  convexity, 
we  also  have  M0)^0Zi+(^0)zo-  Therefore  ^(0)^r(0)<0Zi-i-(i-0)zo.  Subtracting  ^(0)  gen¬ 
erates  the  expression  O^r(0)-/r(0)<0Zi+(/-0)zo-  h(Q)  (for  any  0).  Hence; 

max  (0z,+  (i-0)Zrt-/t  (0))  >hr{Q)  -/t(0)  .  The  proof  is  complete  by 
0<Q<1  ^ 

noting  that  the  left  hand  side  of  the  above  inequality  is  -z  (z p  Zq,  b p  bf)  . 

QED  (Theorem  (2)) 
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Theorem  (2)  shows  that  solving  LP02  provides  an  upper  bound  on  the  error  possi¬ 
ble  by  fixing  Xq  =  Xq  for  any  right  hand  side  range  specified  by  O<0<i.  This  theorem  is 

used  throughout  the  rest  of  this  chapter.  This  theorem  provides  a  basis  to  verify  whether  or 
not  a  particular  initial  decision  variable(s)  is  optimal  over  a  range  of  right  hand  side  values 
and  to  generate  reasonable  error  bounds  for  the  initial  decision  variable(s)  of  a  particular 
right  hand  side,  given  these  decision  variable(s)  remain  fixed  over  a  range  of  potential  right 
hand  sides. 

C.  SPECIAL  CASE:  THE  OPTIMAL  VALUES  FOR  Q=0AND  1  HAVE 
THE  SAME  BASIS 

Define  x^  and  x^  as  the  optimal  decision  variables  to  LP0/  for  Q=0  and  1  respec¬ 
tively.  If  andx^  have  the  same  optimal  basis  B,  /j(0)=0Z7+(/-0)zoand  the  basis  stays  fea¬ 
sible  over  the  range  of  0  since  QBx^=ebj,  {l-%)Bx^={l-Q)bQ,  which  implies 
B(0jc4(7-0)j»:^)=0Z>7+(i-0)^O.  Since  the  max  dual  extreme  point  7t‘*=  c^B'^  is  the  same  for 
both  h{0)  and  h{l).  Property  X  provides  that  for  all  0<Q<1, 7t'*  is  a  max  dual  extreme 
point.  It  is  important  to  note  thatx®  and  having  the  same  basis  implies 
/i(0)=0Z7+(/-0)Z(9,  however  ^(0)=0z 7+(i-0)Zp  does  not  necessarily  imply  that  x^  and  x^ 
have  a  common  optimal  basis. 

D.  ALGORITHM  XqOPTIMAL:  DETERMINING  IF  Xo  IS  OPTIMAL 
FOR  0,  O<0<1 

The  following  algorithm  determines  if  Xg  is  optimal  for  O<0<7. 

(1)  Set  i  ‘-7,  0lower(*)‘'^>  ^upperC*')*'-^- 

{Evaluate  until  discover  Xq  not  optimal  or  until  all  points  of  non-differentiability 
of  7t(0)  examined} 

(2)  While  i>7  Do 
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{Set  objective  function  values  and  appropriate  RHS  for  interval  of  interest} 


(3) 

(4) 

(5) 

(6) 


(V) 

(8) 


(9) 


(10) 


(11) 

(12) 

(13) 

(14) 

(15) 

(16) 


(17) 

(18) 


2o(^')*”^^(®lower(*)) 

Z\(f)  ^^^(0upper(*)) 
i»o(0-(^eiower(0)*0+(Ol  ower  (0)^1 

^  1  (*)*"  (^“Oupper(0)^0"*'(Oupper(0)^  1 

(Solve  for  maximum  difference  between  LP01  and  feasible  convex  combination 
over  0  interval  of  interest} 

Solve  LP02.  Difference^ z  (Zj  (i) ,  Zo(i) ,  bj  (i) ,  bo(i) ) 

0  ^  optimal  0  generated  by  solving  LPQ2 

(Convert  0  of  scaled  interval  back  to  original  0<Q<1  interval} 

0(0  ^  (0/„..r(O)  (i-e)  +  i^pperii))  (0) 

(Determine  if  LP01  lies  on  line  generated  by  convex  combination} 

If  (Difference=0)  then... 

(If  Difference  =0  and  i=l,  then  either  first  iteration  has  shown  objective  function 
lies  on  convex  combination  line,  or  all  possible  non-differentiable  points  have 
been  identified} 

If  (/=i)  then... 

Stop,  Xo  optimal  for  O<0<i 

Else 

i^i-1 

Endif 

Else 


(Determine  if  Xg  optimal  at  point  of  non-differentiability  of  LP0/ } 

Solve  LP07,  Zfree-hiQ  (i)  ) 

Solve  LPQ3,  Zrestricted*-hr{Q  (i) ) 

(Implication  is  if  Zfree<Zrestricted,  then  Xq  cannot  be  optimal  to  LPQl } 
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(19)  \f  {Zfree<Zrestricted)  then. 

(20)  Stop,  Xq  not  optimal  for  0<Q<1 

(21)  Else 

{Set  up  next  division  of  interval,  splitting  original  interval  into  two 
new  subintervals} 

(22)  Slower  (0  (i) 

(23)  ^upper  (0  ^  ^upper  (0 

(24)  e 

lower  (/+i)^0 

lower  (i) 

(25)  Qupper(i+1) 

(Increment  i  to  reflect  additional  subintervals  need  to  be  tested} 

(26)  i-i+1 

(27)  End  If 

(28)  End  If 

(29)  End  While 

This  algorithm  systematically  identifies  (if  needed)  each  non-differentiable  point 
for  h{Q),  terminating  only  when  the  algorithm  identifies  a  non-differentiable  point  where 
Xf,  is  not  part  of  the  optimal  solution,  or  after  visiting  all  non-differentiable  points.  Termi¬ 
nation  is  guaranteed  since  there  are  only  a  finite  number  of  non-differentiable  points.  If  Xq 
is  optimal  for  all  the  non-differentiable  points,  then  Xg  is  optimal  over  the  entire  range  of 
0.  Figure  7  illustrates  the  first  two  iterations  of  this  algorithm,  and  Figure  8  illustrates  the 
behavior  of  this  algorithm  on  problem  LPEXl  (from  Section  A). 
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Figure  7. 

Algorithm  to  determine  if  Xq  is  optimal  for  0,  0<B<1. 


Figure  8. 

Illustrating  algorithm  JCoerror  using  LPEXl. 


E.  AN  UPPER  BOUND  ON  DEVIATION  FROM  THE  OPTIMAL 
OBJECTIVE  VALUE  WHEN  Xo  IS  FIXED  OVER  O<0<1 

Whether  or  not  xl^i^x'o,  we  still  desire  to  know  how  good  the  initial  decision 

xl  =  Xo  is  over  the  range  of  0, 0<Q<1.  Given  Xq  is  feasible  over  the  range,  it  is  possible  to 
generate  a  simple  upper  bound  on  the  potential  error  associated  with  this  decision  variable 
over  the  range  of  0.  To  illustrate  the  concept  involved,  determine  the  optimal  objective  val- 
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ue  of  LP07  for  6=0,  and  set  Z()=h(0).  Now  fix  Xg  =  and  solve  LP63  fixing  0=7.  Set 
Zi=hr(l).  Now  solve  LP62.  Figure  9  graphically  illustrates  the  result; 


Figure  9. 

Generating  an  upper  bound  on  the  error  associated  with  Xg . 

By  convexity  (0)z;+(7-0)zo>  h{6),  and  (0)z;+(7-0)zo^ hr(6)  (with  Xq=Xo).  The 
maximum  difference  between  h(6)  andzy(0)+Zo(7-0)  occurs  either  at  a  point  of  non-differ¬ 
entiability  ofh(6),  or  at  0=7,  and  the  resulting  solution  to  LP62,  \z\ ,  provides  a  weak  upper 
bound  on  the  error  associated  with  using  Xg  over  the  entire  range  of  0, 0<6<1.  This  suggests 
an  algorithm  can  be  developed  to  generate  a  sequence  of  non-increasing  bounds  on  the  dif¬ 
ference  between  hr(6)  and  7e(0);  i.e.,  the  error  associated  with  using  XQ=Xg . 

F.  ALGORITHM  GENERATING  NON-INCREASING 

UPPER  ERROR  BOUNDS 

The  following  algorithm  generates  a  non-increasing  sequence  of  weak  upper 
bounds  on  the  error  associated  with  using  Xg  over  the  entire  range  of  0,  0<6<1 .  This  algo¬ 
rithm  is  similar  in  many  respects  to  XQOptimal. 
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{Initialize  Algorithm} 

(1)  Set  d^-l,  i  *~1,  ^\Qy/Qj;(d,i)'-0, 

(2)  Set  MaxDijf'-O,  MaxJ*- Maximum  number  of  iterations. 

(Evaluate  until  best  upper  bound  found} 

(3)  While  {i>l  and  d^axd)  Do 

(4)  Divd^O,  imax^O 

(5)  While  (i>l)  Do 

(Solve  for  objective  function  values  (LPQ3)  and  appropriate  RHS  for  interval  of 
interest} 

(6)  Zo(0*“^^(®lower(^4)) 

(7)  Zj(i)^hr(Q^pp^^(d,i)) 

(8)  bQ{i)'-{l-Q\Qy^Qjid,i))bQ+{QiQ’^Qj(d,iy)b-[ 

(9)  ^/(0*”(^"®upper(^4'))^O"*'(®upper(^’0)^l 

(Solve  for  maximum  difference  between  LPQl  and  feasible  convex  combination 
over  6  interval  of  interest} 

(10)  Sol\e  LPQl.  Difference  ^  \z  (Zj  (i) ,  Zoii) ,  b,  (i) ,  boii))\ 

(11)  6  optimal  0  generated  by  solving  LPQl 

(Convert  0  of  scaled  interval  back  to  original  O<0<7  interval} 

(12)  0(0^  (0  )  (^  -  6)  +  i^pper  (0  )  (0) 

(Determine  if  LP0i  lies  on  line  generated  by  convex  combination} 

(13)  If  (Difference=0)  then. . . 

(If  Difference  =0  and  d=l  the  first  iteration  has  shown  optimal  objective 

function  lies  on  convex  combination  line} 

(14)  If  (d=/)  then... 

(15)  Stop,  Xq  optimal  for  O<0<1 

(16)  Endif 

(17)  Endif 

(18)  If  {Difference  >Divd)  then 
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(19) 


Divd*-Dijference 


Endif 

{Set  up  next  division  of  interval,  splitting  original  interval  into  two 
new  subintervals} 

(20)  Q,„^^^{d+l,imax+l)  <-9(0 

(21)  Supper  {d+l  imax+1)  <r-  0  Upper  {d.i) 

(22)  e,o^er  id+l,imax+2)  ^  {d,i) 

(23)  Q„pper(d+l,imax+2) 

(24)  imax^imax+2 

(25)  i-i-1 

(26)  EndWhile 

(27)  If  (Divd=0) 

(28)  MaxDijf^Divd 

(29)  Done 

(30)  Endif 

(31)  \i{Divd=MaxDijf} 

(32)  Done 

(33)  Else 

(34)  MaxDijf^Divd 

(35)  d^d+1 

(36)  i'-imax 

(37)  Endif 

(38)  EndWhile 

This  algorithm  generates  a  non-increasing  sequence  of  error  bounds  (MaxDiff).  The 
first  iteration  “J=  7”  solves  for  the  maximum  distance  between  the  objective  function  de¬ 
fined  by  the  convex  combination  of  optimal  objective  function  values  Zq  (best  value  using 

RHS  Bq),  and  zi (best  value  using  RHS  7>i  restricted  to  include  Xo=Xo).  This  maximum  oc¬ 
curs  at  some  point  6 .  This  is  illustrated  by  Figure  9.  The  second  iteration  solves  for 

the  maximum  distance  between  the  convex  combination  of  optimal  objective  function  val¬ 
ues  Zq  and  hr  (Q)  ,  and  the  convex  combination  of  optimal  objective  function  values 

hr  (0)  andzj.  This  iterative  process  continues  with  the  number  of  steps  for  each  division 
potentially  growing  by  a  factor  of  two  for  each  iteration.  The  number  of  iterations  for  each 
division  can  be  reduced  if  one  uses  the  distances  obtained  from  the  previous  division  to  as- 
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sist  in  determining  the  most  appropriate  sections  to  examine.  However,  the  purpose  here  is 
to  illustrate  the  basic  concepts. 

Figures  10  and  1 1  show  the  XoError  algorithm  executed  on  a  hypothetical  example. 
Figure  12  illustrates  x^Error  for  the  example  problem  LPEXl. 


Figure  10. 

Error  bound  generated  after  first  two  iterations  of  XoError. 


Figure  12. 

Illustrating  algorithm  XQError  using  LPEXl . 

G.  BOUNDING  THE  ERROR  ASSOCIATED  WITH  LPoo  INITIAL 
DECISIONS 

Figure  13  shows  an  infinite-horizon  problem  that  may  be  bounded  by  using  primal 
and  dual  equilibrium  approximation. 


Minimize  cXq  +  ^  a*  ^cx- 
i  =  } 

Subject  to: 

II 

iO) 

HjXq+  AXj 

=  bj 

(1) 

H2Xq'¥  KjXj+  Ax2 

II 

to 

(2) 

H^Xg^  K2Xj-\-  KjX2-^  AXj 

II  •• 

(3) 

..  Ax^  =  bj^ 

(L) 

^ ^L’-2^3 

'' 

(L+l) 

Xf>0  {i=0,l,2,...) 

Figure  13. 

Illustration  of  LP°°  for  which  primal  and  dual  equilibrium  approximation  is  applicable. 
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Further  assume,  that  for  some  k,  bn=bn+i,  for  all  n>k.  Also  note  that  the  dimension¬ 
ality  of  ;ir;,  X2,  X3,...  may  differ  from  Xg .  Chapter  2  illustrates  that  both  primal  and  dual  equi¬ 
librium  approximations  can  be  used  for  the  problem  illustrated  in  Figure  13. 

This  section  uses  the  following  notation: 

Aj,  the  coefficient  matrix  associated  with  dual  equilibrium  approximation; 

Ap,  the  coefficient  matrix  associated  with  primal  equilibrium  approximation; 

C(j,  the  cost  vector  associated  with  dual  equilibrium  approximation; 

Cp,  the  cost  vector  associated  with  primal  equilibrium  approximation; 
jC(j,  the  decision  variables  associated  with  dual  equilibrium  approximation; 
jCp,  the  decision  variables  associated  with  primal  equilibrium  approximation; 
b,  the  right  hand  side  of  any  infinite-horizon  formulation; 

bo,bj,  infinite  right  hand  sides  of  interest  such  that  for  some  k,  b^=b^^i,  for  all  n>A:; 
b{Q)={\-Q)ba^^b  1,  0<9<7,  any  right  hand  side  value  defined  as  a  convex  combina¬ 
tion  of  Z>o  and  ftj; 

7»p(0),  the  right  hand  side  of  ^(0)  in  the  primal  equilibrium  approximation; 

7>^0),  the  right  hand  side  of  ^(0)  in  the  dual  equilibrium  approximation; 
hp(Q),  the  optimal  objective  function  value  for  the  primal  equilibrium  approxima¬ 
tion  with  right  hand  side  value  b(B)=(l -Q)bQ+Qb j‘, 

hpr(Q),  the  optimal  objective  function  value  for  the  primal  equilibrium  approxima¬ 
tion  with  right  hand  side  value  b(Q)={l-Q)bQ+Qb],  including  restricting  initial  decision  vari¬ 
ables  to  optimal  values  associated  with  right  hand  side  bg,  and 

hdiB),  the  optimal  objective  function  value  for  the  dual  equilibrium  approximation 
with  right  hand  side  value  b(B)={l-Q)bQ+Qbj. 
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The  following  useful  relationships  hold  for  primal  and  dual  equilibrium  approxima¬ 
tions: 

•Given  any  0<e<l,  and  any  b{%)={\-Q)bo+^bj,  the  primal  equilibrium  approx¬ 
imation  optimal  objective  function  value  is  greater  than  or  equal  to  the  dual 
equilibrium  approximation  optimal  objective  function  value,  i.e., 
hp{Q)^d((d). 

•Let  Xg  represent  a  optimal  solution  for  a  set  of  initial  decision  variables  to  the 
primal  equilibrium  approximation  evaluated  at  b^.  Now  fix  the  initial  deci¬ 
sion  variables  to  the  primal  equilibrium  approximation  to  Xg ,  and  assume  that 
for  any  O<0<7,  that  Xg  is  feasible  over  the  primal  feasible  region  defined  by 
bp{Q)  and  solve  for  optimal  solution  of  this  restricted  primal  equilibrium  for¬ 
mulation  for  any  0,  hpr{Q).  Then  hpr{%)  is  finite  and  hpr{Q)^p{&)  for  all 
0<Q<1. 

The  relationship  between  hpriQ),  hpiQ),  and  hdiQ)  is  illustrated  by  Figure  14. 


Figure  14. 

Illustration  of  the  relationship  between  hd(Q),  hp(Q),  and  hpr(Q). 
(hpr{Q)^piQ)^d(Q)) 

This  relationship  can  be  exploited  to  obtain  an  upper  bound  on  the  error  associated 
with  fixing  initial  decisions  associated  with  right  hand  side  bQ. 
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Consider  the  linear  programs: 

LPooQl 

hd(Q)  =  Minimize  CjX^ 

Subject  to: 

X  =  {Xq,  Xj,  X2, . . -X^)  >  0. 

LP'^Q2: 

Z  (Zp  Zq,  bp  Bq)  =  Minimize  -  {ZjQ  +  Zq(1  -Q)) 
Subject  to: 

AjX^>bjie)  +bf){l-Q) 
x>0,0<Q<l. 


LP^QS: 

hpr  (Q)  =  minimize  CpXp 
Subject  to: 

Xo  =  Xq 

x>0. 

Algorithm  xo^rror  with  only  slight  modifications  can  be  applied  to  iteratively  gen¬ 
erate  improving  upperbounds  on  the  gap  between  hpr(Q)  and  hdiQ). 

Algorithm  XQError°°: 

{Initialize  Algorithm} 

(1)  Set  d=l,  i  =7,  0jower(^’^')~^’  0upper(^’*)“'^’ 

(2 )  Set  MaxDiff-0,  MaxJ- Maximum  number  of  iterations. 

(Evaluate  until  best  upper  bound  possible  found) 

(3)  While  (i>l  and  d^axd)  Do 

(4)  Divd-O,  imax^O 

(5)  While  (i>l)  Do 


109 


{Solve  for  objective  function  values  (LP<»03)  and  appropriate  RHS  for  interval  of 
interest} 

(6)  Zo{i)-hpr{%x  ower  id,i)) 

(7)  Z]ii)'~hpj'(Q^ppQj(d,i)) 

(8)  bQ(i)^{l-QiQ,^Qj;(d,iy)bp{0)+{QiQ-^Qj-id,iy)bp{l) 

(9)  bj{i)*-(  1  -6upper(^’*))^p(0)+(6upper(‘^>0)^;7(  ^  ) 

(Solve  for  maximum  difference  between  LP°°B1  and  feasible  convex  combination 
over  0  interval  of  interest) 

(10)  Solve  LPOO02.  Difference-\z  (z,  (i) ,  Zoii) ,  bj  (0 ,  bo{i) )  \ 

(11)  e<-  optimal  0  generated  by  solving  LP~02 

(Convert  0  of  scaled  interval  back  to  original  interval) 

(12)  0(0  (0/ower(O)  (7-9)  +  (0«pper(O)  (9) 

(Determine  if  LP°°B1  lies  on  line  generated  by  convex  combination) 

(13)  If  {pijference=0)  then... 

(If  Difference  =0  and  d=l,  first  iteration  has  shown  optimal  dual  equilibrium 
objective  function  lies  on  convex  combination  line  that  provides  an  upper  bound 
for  the  restricted  primal.  If  this  holds,  then  primal  equilibrium  equals  dual 
equilibrium,  and  the  infinite  optimal  solution  has  been  obtained,  and  Xq  is  an 
infinite  optimal  initial  decision  variable) 

(14)  If  ((i=7)  then... 

(15)  Stop,  Xo  optimal  for  O<0<7 

(16)  Endif 

(17)  Endif 

(18)  If  {Difference>Divd)  then 

(19)  Divd^Difference 

Endif 

(Set  up  next  division  of  interval,  splitting  original  interval  into  two 
new  subintervals} 

(20)  0,„„„  {d+1, imax+1)  <-0(0 


no 


(21)  Supper  id+1^  imax+1)  <-  0  upper  {d,i) 

(22)  Q lower  (d+l,imaX+2)  <r-  Q lower  (dj) 

(23)  Qupper  id+l,imax+2)  4-  0  (i) 

(24)  imax^imax+2 

(25)  M-1 

(26)  EndWhile 

(27)  If  (Divd=0) 

(28)  MaxDiff^Divd 

(29)  Done 

(30)  Endif 

{if  max  gap  this  division  equal  to  max  gap  of  last  division,  done,  as  found  best 
possible  gap  for  this  algorithm) 

(31)  If  (Divd=MaxDiff) 

(32)  Done 

(33)  Else 

(in  this  case  Divd<Maxdiff,  so  update  Maxdiff) 

(34)  MaxDiff^Divd 

(Move  onto  next  division) 

(35)  d-d+1 

(Set  next  division  starting  point) 

(36)  i-imax 

(37)  Endif 

(38)  EndWhile 

Applying  algorithm  iteratively  generates  improving  upper  bounds  on  the 

gap  between  hpr{&)  and  hd{Q).  This  bound  occurs  either  at  a  non-differentiable  point,  or 
at  the  value  0=7.  Figures  15  and  16  graphically  illustrate  the  algorithm. 


Ill 


Objective  Function  Value  o  g  Optimal  Objective  Function  Value 


In  the  above  example,  02,  is  the  point  where  the  maximum  gap  exists  between 
hpj.{Q)  and/rrf(0).  In  this  casex^Erraroo  would  run  for  one  more  iteration,  generate  the  same 
gap,  then  terminate. 

H.  SUMMARY 

This  chapter  develops  a  method  to  examine  the  error  potential  of  fixing  the  initial 
decision  variable(s)  for  finite  and  infinite-horizon  linear  programs,  over  a  linear  convex 
combination  of  potential  right  hand  side  values.  For  solving  LPo°,  these  algorithms  can  pro¬ 
vide  insight  regarding  the  stability  of  the  initial  decision  variable  for  the  original  infinite- 
horizon  program  as  the  restricted  primal  equilibrium  approximation  and  dual  equilibrium 
approximation  still  bound  the  infinite-horizon  optimal.  The  algorithms  of  this  chapter  un¬ 
fortunately  are  not  applicable  for  MIP<»,  as  the  primal  equilibrium  approximation  solution 
hull  hp{Q)  is  neither  convex  or  continuous  over  0<Q<1. 

This  ability  to  deal  with  variations  in  the  right  hand  side  value,  provides  some  flex¬ 
ibility  in  extending  truncated  formulations  over  the  infinite  horizon  as  a  method  for  elimi¬ 
nating  the  end  effects  associated  with  a  finite  horizon.  The  next  two  chapters  of  this 
dissertation  apply  the  developed  theory  to  a  real  world  Lfoo  and  M/P<». 
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VI.  APPLYING  PRIMAL  AND  DUAL  EQUILIBRIUM 

APPROXIMATION  METHODS  TO  QUANTIFY  END  EFFECTS 
FOR  LINEAR  PROGRAMS 

This  chapter  examines  the  capability  of  primal  and  dual  equilibrium  approxima¬ 
tions  to  bound  the  infinite  optimal  objective  function  value  and  quantify  end  effects  for  a 

large  scale,  military  manpower  planning  model'^Clinear  program).  This  is  the  first  real- 
world  example,  known  to  the  author,  to  use  both  primal  and  dual  equilibrium  approxima¬ 
tions  to  quantify  the  impact  of  end  effects  and  provide  feasible  near  optimal  solutions  to  the 
infinite-horizon  problem.  The  methodology  proves  highly  successful  applied  over  a  rela¬ 
tively  short  solution  horizon.  Dual  and  primal  equilibrium  approximations  provide  a  tight 
bound  for  the  infinite  optimal  and  effectively  eliminate  key  end  effects  found  to  adversely 
influence  the  optimal  solutions  provided  by  finite-horizon  formulations.  Section  A  pro¬ 
vides  a  brief  summary  of  research  conducted  using  LPoo  solution  techniques.  Section  B  in¬ 
troduces  the  LP  of  interest.  The  Total  Army  Manpower  Life  Cycle  Model  (TAPLIM)  and 
the  Future  Personnel  Extension  (TAPLIM/FPS).  The  TAPLIM  series  of  models  are  cur¬ 
rently  used  by  the  Directorate  of  Military  Personnel  Management,  Deputy  Chief  of  Staff 
for  Personnel,  United  States  Army  (ODCSPER)  as  decision  aids  for  setting  personnel  re¬ 
cruiting,  hiring,  promotion,  and  retention  policies.  Section  C  provides  a  detailed  formula¬ 
tion  of  TAPLIM/FPS.  This  section  derives  a  modification  to  the  original  TAPLIM/FPS 
model  structure  that  more  fully  integrates  the  FPS  extension.  Section  D  extends  TAPLIM/ 
FPS  to  an  infinite  horizon  problem  and  derives  dual  and  primal  equilibrium  approxima¬ 
tions.  Section  E  examines  TAPLIM  using  primal  and  dual  equilibrium  approximation 
methods.  Analysis  and  results  illustrate  the  power  of  the  primal  and  dual  equilibrium  ap¬ 
proximations  to  bound  the  infinite  optimal  solution  and  capture  and  quantify  end  effects. 


See  Gass  (1991)  for  an  overview  of  approaches  used  in  military  manpower  planning  models. 
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Section  E  also  examines  the  impact  on  the  initial  decisions  of  varying  the  right  hand  side 
over  a  functional  range.  Section  F  summarizes  the  key  results  of  this  chapter. 

A.  BACKGROUND 

The  focus  of  past  research  on  end  effects  has  been  convergence  of  the  optimal  so¬ 
lution  for  primal  and/or  dual  equilibrium  approximation  methods  to  an  optimal  solution  for 
the  infinite  horizon  problem.  Grinold  (1971,1977)  and  Svoronos  (1985)  derive  problem 
structures  that  assure  convergence  of  the  primal  and/or  dual  equilibrium  approximations  to 
an  infinite  horizon  optimal.  From  this,  inferences  are  made  regarding  the  impact  of  end  ef¬ 
fects  on  initial  period  solutions.  In  general,  however,  whether  or  not  the  primal  and/or  dual 
equilibrium  approximations  converge  to  an  infinite  horizon  optimal  is  not  critical  to  the 
practical  implementation  of  these  methods  to  bound  the  infinite  optimal  solution.  As  long 
as  primal  and  dual  equilibrium  approximations  are  found  that  generate  a  narrow  bound  for 
the  infinite  horizon  objective  value,  then  inferences  can  be  made  regarding  the  impact  of 
end  effects  on  the  feasible  set  of  initial  decision  variables  provided  by  the  primal  equilibri¬ 
um  approximation.  This  chapter  illustrates  that  for  TAPLIM,  convergence  does  not  have  to 
be  proved  to  obtain  near  optimal  solutions  where  end  effects  are  negligible. 

B.  TAPLIM/FPS 

TAPLIM  is  a  large  scale  military  manpower  planning  model  originally  developed 
by  COL  Anthony  Durso,  USA  (retired),  while  assigned  to  RAND  Corporation,  Santa  Mon¬ 
ica,  California.  A  brief  description  of  TAPLIM  and  TAPLIM/FPS  follows.  For  additional 
detail,  see  Durso  and  Donohue  (1994). 

While  TAPLIM/FPS  forms  one  model,  it  is  comprised  of  two  distinct  sections, 
TAPLIM  and  FPS.  Both  are  identified.  As  TAPLIM/FPS  is  the  more  general  model,  it  is 
presented  first.  Section  E  of  this  chapter  presents  the  simplified  formulation  for  TAPLIM 
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derived  from  TAPLIM/FPS  by  modifying  a  single  index  set  and  removing  the  constraints 
\vhich  generate  the  FPS  extension. 

TAPLIM/FPS  examines  the  dynamics  of  the  Army’s  enlisted  personnel  inventory 
as  changes  in  manning  level  requirements  occur  over  time.  The  model  has  multi-period 
generalized  network  flows  and  a  relatively  large  number  of  side  constraints.  Durso  and 
Donohue  use  three  distinct  networks,  which  are  tied  together  with  additional  constraints. 
The  first  network  directs  the  flow  of  initial  enlistees  by  their  initial  contractual  obligation 
through  their  first  6  years  of  service;  the  second  network  directs  the  flow  of  service  years 
for  personnel  by  rate  for  each  time  period;  the  third  directs  the  flow  of  transfers  between 
geographic  areas  by  rate  for  each  time  period.  The  first  two  networks  form  the  base 
TAPLIM  model,  and  the  third  forms  the  FPS  extension.  Figures  17  to  19  show  these  net¬ 
work  structures: 


Figure  17. 

Network  tracking  initial  enlistees. 
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Figure  18. 

Network  tracking  personnel  by  rate  and  years  of  service. 


to  other  areas  to  other  areas 


Figure  19. 

Network  tracking  movement  of  personnel  between  geographic  areas. 

The  data  sets  that  influence  the  enlisted  force  structure  include: 

•Billet  requirements.  Defined  by  rate  for  each  main  geographic  area  and  time 
period  (year).  Billet  requirements  reflect  area  manning  requirements. 
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•Total  End-of-Year  Manpower.  This  reflects  the  total  number  of  enlisted  per¬ 
sonnel  allowed  to  be  on  active  duty  at  the  end  of  each  period. 

Decision  variables  include: 

•The  number  of  accessions  (new  recruits)  per  year.  An  implementation  of  the 
model  provided  by  ODCSPER,  fixes  the  number  of  accessions  for  periods  2, 
3, 4, 5,  and  6,  (the  first  5  periods  of  the  model,  as  there  is  no  period  1)  allow¬ 
ing  the  variable  to  float  from  period  7  onward.  Subject  to  manning  require¬ 
ments,  the  model  seeks  to  minimize  accessions. 

•Number  of  personnel  continuing  in  rate,  by  years  of  service,  for  each  time 
period.  This  decision  variable  dictates  the  potential  to  fill  future  requirements 
for  promotion,  and  current  manpower  needs  (by  rate). 

•The  number  of  personnel  selected  for  promotion  to  the  next  higher  rate,  by 
years  of  service  for  each  time  period.  The  size  of  the  rate  population  limits  the 
number  of  promotions  to  the  next  higher  rate.  The  model  seeks  to  maximize 
promotions  while  satisfying  manpower  requirements  for  each  rate. 

•The  number  of  involuntary  separations.  This  reflects  the  number  of  personnel 
by  rate  and  years  of  service  who  involuntarily  leave  the  service  each  time 
period.  The  model  seeks  to  develop  a  solution  which  minimizes  involuntary 
separations,  as  such  separations  are  detrimental  to  morale,  while  meeting 
manning  and  billet  requirements. 

•The  number  of  personnel  that  take  some  form  of  early  voluntary  separation, 
by  rate  and  years  of  service.  Congress  authorizes  DOD  to  provide  financial 
incentives  for  selected  rates  to  voluntarily  separate  prior  to  the  end  of  their 
enlistment.  In  the  model,  voluntary  separation  occurs  at  the  E-4  and  E-5  level. 
The  model  seeks  to  minimize  voluntary  separations,  while  meeting  manning 
and  billet  requirements. 

•The  model  deviation  between  actual  manning  and  billet  requirements.  The 
model  minimizes  manning  deviations  (over  or  under  manning  of  billets). 

Side  constraints  that  drive  the  flows  across  the  network  structures  include: 

•Ensuring  initial  enlistees  encompass  minimum  proportion  of  total  lower  rate 
population  base. 

•Fixing  attrition  losses  to  a  proportion  of  the  total  number  in  the  rate. 
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•Retire  all  E-5’s  at  the  15  year  point  in  their  career,  but  allow  any  E-5  with 
more  than  15  years  at  the  start  of  the  model  to  continue  to  20  years  (known  as 
grand-fathering  a  new  policy). 

•Retire  all  E-6’s  at  20  years,  and  implement  early  retirement  policy  for  E-7’s. 
•Distribute  those  selected  for  promotion  by  years  of  service. 

•Control  the  number  of  transfers  between  areas,  for  each  rate. 

•Satisfy  minimum  manning  requirements  in  each  geographic  area. 

•Limit  upper  rate  manning  levels  to  a  proportion  of  total  rate  manning  levels. 
•Limit  the  number  of  personnel  allowed  to  voluntarily  separate. 

ODCSPER  implements  and  solves  TAPLIM  and  TAPLIM/FPS  using  the  Linear  In¬ 
teractive  Discrete  Optimizer,  (LINDO),  (Schrage,  1991).  The  LINDO  implementation  of 
TAPLIM/FPS  with  some  documentation  was  provided  by  the  Directorate  of  Military  Per¬ 
sonnel  Management,  Deputy  Chief  of  Staff  for  Personnel,  U.S.  Army.  The  version  provid¬ 
ed  covers  9  fiscal  years,  however,  because  of  the  model’s  staircase  structure  the  number  of 
time  periods  can  be  easily  increased  or  decreased.  TAPLIM/FPS’s  periodicity  and  semi¬ 
invariant  staircase  structure  (i.s.,  equation  and  right  hand  side  coefficients  from  period  to 
period  become  identical  from  year  9  onward)  make  the  model  a  candidate  for  employing 
infinite-horizon  linear  programs  to  analyze  the  stability  of  initial  decision  variables  as  the 
future  enlisted  force  structure  of  the  Army  varies. 

C.  FORMULATION  OF  THE  TRUNCATED  MODEL 

A  formulation  for  TAPLIM  or  TAPLIM/FPS  was  not  available  from  ODCSPER. 
Accordingly,  this  dissertation  derives  a  formulation  by  examining  the  LINDO  code  provid¬ 
ed,  and  modifies  it  by: 

•Discounting  the  objective  function.  This  is  commonly  used  to  reflect  the 
increased  value  of  choices  made  today  (as  they  are  implemented  immedi¬ 
ately),  versus  choices  made  for  some  future  time  period.  Infinite-horizon 
approximation  techniques  can  be  used  when  the  objective  is  discounted. 
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•Expanding  the  underlying  network  structure  to  more  effectively  track  person¬ 
nel  by  both  geographic  area  and  years  of  service  for  each  time  period.  The 
separate  networks  that  track  the  number  of  personnel  by  rate  and  years  of  ser¬ 
vice  and  track  the  number  of  personnel  by  rate  and  geographic  location,  are 
linked  by  constraints  that  match  the  sum  over  years  of  service  of  a  particular 
rate  to  the  sum  over  geographic  areas  of  the  same  rate.  This  leads  to  feasibility 
problems  since  connecting  the  two  sub-networks  in  this  way  can  result  in  sit¬ 
uations  where  transfers  could  never  support  differences  in  years  of  experience 
found  for  the  same  rate  in  a  single  geographic  area  from  period  to  period  (e.g., 
the  number  of  E-4’s  with  3  years  of  experience  in  Germany,  who  did  not 
transfer,  would  not  necessarily  be  reflected  properly  the  next  period  in  the 
number  of  E-4’s  with  4  years  of  experience  in  Germany).  The  new  formula¬ 
tion  combines  two  networks  (Figures  18  and  19)  into  a  single  network  track¬ 
ing  personnel  by  rate,  years  of  service,  and  geographic  location  (Figure  20). 
This  results  in  a  more  complex  model,  with  more  decision  variables,  but  pro¬ 
vides  a  more  complete  underlying  network  structure. 


Number  of  rate  r-1  ,  selected  for  Number  of  rate  “r”,  selected  for 
promotion  to  rate  r  ,  promotion  to  rate  “r+i”, 

transferring  into  area  “g”  transferring  out  of 

with  >7”  yems  of  service, 

in  peno  r-  service  in  period  “r” 

- \  (Includes  loss  paths) 


rate  “r” 


marea  g 
with  “y”  years  of 
service,  in  period 


Number  of  rate  “r” 
transferring  into 
area  “g”,  with  “y-J”  years 
of  service,  in  period  “t-J”. 
(Includes  “g”  to  “g”  transfers) 


Number  of  rate  “r”,  transferring 
out  of  area  “g”,  with 
“y”  years  of  service, 
in  period  “t” 

(Includes  loss  paths) 


Figure  20. 

Network  flow  balance  (flow  by  geographic  area  and  years  of  service). 


The  formulation  follows  an  introduction  to  notation. 
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1.  Indices 

t  time  period  (2, 3,4, 5, 6,.. .7),  {t  starting  with  period  2  reflects  the 

starting  year  (Fiscal  Year  1992)  provided  by  ODCSPER); 
y  years  of  service  {0, 1,  2,...55); 
r  rate  (E4,  E5,  E6,...  E9); 

c  initial  contract  obligation  for  enlistees  (2, 3, 4, 5, 6); 

a  transfer  areas  (boot  camp  (b),  geographic  areas  (9  areas  for  TAPLIM/FPS, 
1  area  for  TAPLIM),  involuntary  separation  (5),  voluntary  separation  (v), 
attrition  losses,  discharge  and/or  retirement  (/)); 
gb  a  subset  of  transfer  areas,  includes  geographic  areas  and  boot  camp; 
g,  g'  a  subset  of  transfer  areas  consisting  of  just  geographic  areas. 

2.  Derived  Sets 

Derived  sets  define  feasible  combinations  of  indices  for  both  variables  and  con¬ 
straints.  These  sets  are  grouped  by  the  constraint  type  and/or  variables  they  are  associated 
with:  transfer/flow  balance,  losses,  tracking  of  initial  enlistees,  voluntary  separation  and 
early  retirement,  and  eligible  years  of  service. 

a.  Transfer/Flow  Balance  Sets 

TALLOW  Areas  (gb,g)  soldiers  can  transfer  between 

(includes  transfers  from/to  the  same  geographic  area  (g,g)); 
PCS  Geographic  areas  (g,g')  soldiers  can  PCS  transfer  between; 

TTOLE  Transfer  paths  (r,  gb,  a,  y)  for  a  soldier  that  is  not  selected 
for  promotion.  This  includes  transfers  to  all  applicable  loss 
areas; 

TTOLP  Transfer  paths  (r,  g,  a,  y)  for  a  soldier  that  is  selected  for 
promotion.  This  includes  transfers  to  all  applicable  loss 
areas. 
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b.  Loss  Sets 

TLFLOW  Loss  paths  (r,y)  for  enlisted  personnel  who  did  not  select  for 
promotion; 

TLPFLOW  Loss  paths  (r,}')  for  enlisted  personnel  who  were  selected  for 
promotion. 

c.  Tracking  Initial  Enlistee  Sets 

YTOS  Allowable  {r,y,t)  used  for  tracking  initial  enlistees  through 

their  first  6  years  of  service; 

NOTYTOS  Allowable  (r,y,t)  for  other  than  initial  enlistees.  This  allows 
the  selection  of  appropriate  flow  loss  equations. 

d.  Voluntary  Separations  and  Early  Retirement  Sets 

YV  Allowable  {r,y)  combinations  for  voluntary  separation; 

YER  Allowable  (r,y)  combinations  for  early  retirement  (r=E5),  or 

selective  early  retirement  (r=E7). 

e.  Eligible  Years  of  Service  Sets 

YEX  Allowable  (r,y)  for  enlisted  personnel  not  selected  for 

promotion  during  a  period.  Includes  all  but  last  year  of 
service  possible  for  the  rate; 

YEXS  Allowable  (r,y)  for  enlisted  personnel  not  selected  for 

promotion  during  a  period.  Identical  to  YEX  except  the  last 

year  of  service  possible  for  the  rate  is  included; 

YPROM  Allowable  (r,y)  for  enlisted  personnel  selected  for  promotion 
to  rate  r  during  each  period. 
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3«  Ddtn 

The  data  divides  into  the  following  groups;  objective  function  drivers,  problem  ini¬ 
tialization,  manpower  requirements,  tracking  initial  enlistment,  promotion  flows,  transfer 
flows,  loss  flows,  and  voluntary  separations  and  early  retirement. 

a.  Objective  Function  Coefficients 


a 

Discount  factor  for  follow  on  period  objective  function 

coefficients; 

WOVERr^g 

Weight  of  overmanning  total  for  area  “g”; 

WUNDER.^g 

Weight  of  undermanning  total  for  area  “g”; 

COSTgg> 

Cost  of  PCS  transfer  from  area  g  to  area  g' ; 

CENLIST^ 

Cost  per  enlistee  with  contract  type  “c”; 

Cs 

Cost  of  involuntary  separation; 

^^r.a,y 

Cost  of  voluntary  separation; 

^Pr,y 

Value  of  promotions. 

b.  Initialization  Data 

EdaiUj-y 

Number  of  personnel  with  rate  “r”,  not  selected  for 

promotion,  with  “y”  years  of  service  at  problem  start; 

Pdata^y 

Number  of  personnel  with  rate  “r-i”,  selected  for  promotion 

to  rate  “r”,  with  “y”  years  of  service  at  problem  start. 

c.  Manpower  Requirements 

TOP 

The  maximum  proportion  of  total  enlisted  force  that  can 
comprise  the  top  enlisted  rates  (E8,  E9).  Currently  set  at 

0.05; 

BILLET^gt 

Number  of  billets  requiring  rate  “r”  in  area  “g”  for  each 

period  “t”\ 
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MAKrgt  Minimum  number  of  personnel  with  rate  “r”  that  must  be 
assigned  to  area  “g”  for  each  period 

PE4  Minimum  proportion  of  all  E-4’s  that  must  be  new  (with  0 

years  of  service); 

TOTALf  Total  allowed  enlisted  manpower  in  the  Army  in  period  “t”; 

UMANt  Limit  on  how  much  the  E-9  rating  can  be  undermanned,  as  a 

proportion  of  total  E-9  manning.  For  time  periods  3  and  4 
only. 

d.  Initial  Enlistee  Data 

PTOScy  Proportion  of  those  who  signed  up  under  contract  type  “c”, 
starting  the  period  with  “y”  years  of  service,  that  survive  to 
“y+1  ”  years  of  service; 

PTERMf.  t  The  minimum  proportion  of  accessions  that  must  enlist  for 

term  “c”,  in  time  period  “t”; 

PACCg  Minimum  proportion  of  accessions  assigned  to  geographic 
area  “g  ”  for  each  time  period; 

NACCf  The  number  of  pre-determined  accessions  for  period  3, 4, 

5,and  6.  After  period  6,  the  number  of  accessions  becomes 
variable. 

e.  Promotion  Flow  Data 

PROf.  (.( PRO  r  f)  Minimum  (maximum)  proportion  of  target  population 
allowed  to  be  selected  for  promotion  to  rate  “r”,  in  time 
period  “t”; 

PYRSr,y  Minimum  proportion  of  rate  “r-i  ”  selected  for  promotion  to 
rate  “r”,  by  years  of  service  “y”,  for  any  time  period. 
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/.  Transfer  Flow  Data 

PPCSr  g  g,(PP^r,g,g)  Minimum,  (maximum)  proportion  of  transfers 

for  rate  “r”  out  of  area  “g”  that  go  to  area  “g' 

TPCSj.g  Minimum  proportion  of  area  force  total  with  rate  “r”,  that 
must  transfer  out  of  area  “g”  for  each  time  period. 

g.  Loss  Flow  Data 

PLOSSj.  g.( FLOSS  .  g)  Minimum  (maximum)  proportion  of  total 
rate  “r”  losses,  for  each  area  “g”; 

NLOSSry  Proportion  of  total  {r,y)  population  lost  to  normal  attrition 
(Honorable  discharge,  retirement,  etc.). 

h.  Voluntary  Separations  and  Early  Retirement  Data 

PVSEPry  Minimum  proportion  of  the  total  number  voluntary 

separations  with  rate  “r”,  broken  down  by  years  of  service 
“y”,  for  each  time  period; 

VMAXr  t  Maximum  number  of  personnel  with  rate  ‘V ’,  that  can  be 
voluntarily  separated  in  period  “t”; 

PER^  y  Minimum  proportion  of  early  retirements  of  rate  “r  ”,  broken 

down  by  years  of  service  “y”,  for  each  time  period; 

E9R3  Limit  the  number  of  E-9’ s  separated  in  key  year  groups,  for 

period  3  only. 

4.  Variable  Definitions 

Fr  a,a’.y.t  Number  of  personnel  in  rate  “r  ”,  starting  period ‘T  in  area  “a  ”, 

being  transferred  to  area  “a'  ”  with  “y”  years  of  service,  not  selected 
for  promotion  to  the  next  higher  rate  in  period  “t”; 
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p 


r,a,a’,  y,t 


ENLIST 


IPROM,yt 


Number  of  personnel  of  rate  ‘V-i  ”,  with  “y”  years  of  service,  in  area 

“a”  at  the  beginning  of  the  period,  transferred  to  area  “o'  ”  during 
the  period,  and  selected  for  promotion  to  rate  “r”  during  period  “f”; 
Number  that  enlist  under  contract  length  “c”  in  period  “t”; 

Number  of  personnel  in  their  initial  service  obligation  remaining 
that  have  not  been  selected  for  promotion  with  enlistment  contract 
“c”,  with  “y”  years  of  service, 
for  each  period  “t”=5  onward; 

Number  of  tracked  accessions  by  contract  length  “c”,  with  “y” 
years  of  service,  selected  for  E-5  in  period  “t” 


(When  y  e  YPROM("E5",  y) ); 

UNDERr  g  f  Number  of  billets  that  require  rate  “r"  personnel,  that  are  not  filled 
in  area  “g”  during  period  ‘7”  =3  onward; 

OVERr  gj  Number  of  excess  personnel  of  rate  “r”  in  area  “g  ”  during  period 
“t”=  3  onward. 


5.  Objective  Function  and  Constraints  for  the  Truncated  Model 

The  following  equations  provide  the  formulation  of  TAPLIM/FPS  for  a  truncated 

linear  program. 
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Objective  Function: 


Minimize 

fss  (  WOVER^  ^OVERj.  g  ,  +  WUNDER^  UNDER^  g  f)  + 
g  r 

cenlist  '^ENLIS T  ,  +  a  (  ^  E^  ^  ^  + 

C  \(r,a,"s",y)  eTLFLOW  ^ 

y  ^  a,  J  2  ^  ^r.  g,  "v",  y,t'^^r^l,  g,  "v",  y, 

{r,y)  eYV  g 

~^Pr,y  2  2  ^r,g,g',y,t'^ 

(r,y)  e  YPROM(g,g')  e  TALLOW 

2  2  ^r,g,g',y,t+  2  ^r,g,g',y,t 

V  {g,g')  e  TALLOW  V  (r,j-)  e  YEX  (.r,y)  £  YPROM 

Constraints: 

^^''E4",“b'',a',"0",2  ~  EdutUg^Q, 


I  E,,a,a’,y,2  =  Eduta,^^ 

{g,  g')  £  TALLOW 

'iir.y)  G  YEX 


X  Er.g,g',y,2  -  Pdata^  y 
g,g'€  TALLOW 

for(r,y)  e  {(E5,3).  (E6,5),  (E7,ll),  (E8,16),  (E9,18)} 


'^ENLlST^f  =  NACCf 


3<t^ 


ENLIST^  ,  >  PTERM^  ^  x  ^ENLIST^  ^ 


\7c,t>3 
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"h"  g,  "n",  t  -  PE4{  ^  ^"E4",gb,g,y,t 

g  igb,  g)  e  TALLOW y:  {E4,y)  s  VEX 

PM[  2  2  ^'’E5'’,g,g\y,?\ 

V  g)  e  TALLOW y:  (B4,  y)  e  rPfiOM  ^ 

\/t>3 


2  2  ^r,  gb,  g,y,t'^ 

gb:  (  €  TALLOW y:  {r,y)  e  y£A: 

2  2  ^r  +  l,g',g,y,t'^ 

g':  (  g,g)  e  TALLOW y:  (r  +  l,y)e  YPROM 

UNDER^^,-OVER^^,  =  BILLET 
^r^5,t>3 


2  2 

{g,  a) :  (r,  g,  a,  y)  e  TTOLPy.  (r,  3-)  e  YPROM 

2  2 

V  (^gb,a}:(r-l,gb,a,y)  e  TTOLEy:{r-l,y)  e 


-  7,  gb,  a,y,t 


PROrA  2  2  ^ 

^  (g, «)  ••  (r,  g,  fl,  J)  e  TTOLPy:  (r,  3-)  e  FF/fOM 

\/r^5,t>3 


r,  g,a,y,t 


2  2 

(g,  a)  •  (r,  g.  a,  3-)  e  TTOLPy:  (r,  3-)  e  YPROM 


P 

r,  g,  a,  y,  t 


(gb,  a) :  (r  -  1 ,  gb,  a,  y)  e  TTOLEy:  (r  -  l,y)  e  YEX 


P'r  - 1,  g,  a,y,t 


’  ^  (g, «)  ••  (.r,  g,  a,  y)  e  TTOLPy:  (r,  3-)  e  YPROM 


r,  g,  a,  y,  t 
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y  P  ,> 

^  r,g,a,y,t 

(g,a):(r,g,a,y)  e  TTOLP 

(g, «)  (.r.g,a,y)  e  TTOLP y:  (r,  >>)  e  YPROM 

\fr^5. 


(14) 


^"£4”,  "b",  g,  "0",  t  -  ^  '^^"£4",  "b",  g,  "0",  t 

g 

\/g,  c,  f>5 


(15) 


I 

y:{r,y)  e  Y£X 


^r,  g,  g\  y,  t 


y:(r  +  l,y)  e  YPROM 


P  > 

r  +  l,g,g,y,t  - 


PPCS^  ^  _ 

'’'-g:(g,g')eTALLOW\y:(r,y)sYEX 

'ir,(g,g')  e  TALLOW, t>3 


S  ^r,g,g',y,t'^ 


y:{r+I,y)  s  YPROM 


r-yl,g, 


(16) 


X  ^r,g,g\y,t'^ 


y:  {r,y)  e  YEX 


s 

y:  (r  l,y)  e  YPROM 


P  < 

r  +  i,  g\  J,  t  “ 


S 

^  q' :  (£.  2')  €  T 


PPCS, 

\fr,  ig.g')  e  TALLOW, 


X 


g,g',y,t'^  X  ^r  +  l,g,g\y,t  \  \ 

g':{gyg')  €  TALLOW"^ y:{r,y)  e  KEX  >.  (r+A3')  e  YPROM  ^  ' 


^^(17) 


X  (  X 

g':{g,g')^fCS^y-ir,y)  6  Y£X 


P  a-  >  P  ,  1  > 

r,g,g\yyt  La  r-k-Ug^g^yJ 

y:(,r’\-Uy)  e  YPROM 


TPCS  X 

- g.r 


\/rygy  t>3 


ig,g')ePCS^y-(r,y)eYEX 


^r,gyg\yj'^  ^  ^r  +  l,gyg\yyt 

y:{r+l,y)  e  YPROM 


(18) 


X  ^r,g,a,y,t'^  X 

(a,  y) :  (r,  g,  a,  y)  €  TLFLOW  (a,  y) :  (r  +  7,  a,  >)  €  TLPFLOW 


P  > 

^  r-hlyg,ayyyt- 


PLOSS  Y 

- r,  g,tZ^ 

g 

\/r,g,t>3 


X  ^r,g,a,y,t'^  X  Pr  +  l,g,a,y,t 

(fl,  >) ;  (r,  g,  a,  y)  e  TLFLOW  (a,  3^) ;  (r  +  7,  a,  3^)  e  TLPFLOW 


(19) 


131 


La  r,g,a,y,t  La 

(a,  y) :  (r,  g,  a,  y)  €  TLFLOW  (a,  y) ;  (r  +  7,  g,  a,  >)  e  TLPFLOW 


P  .  < 

r  +  Ug,a,y,t^ 


PLOSS.^gj'^l  X 

g  (a,  j?) :  (r,  g,  a,  y)  e  TLFLOW 


E  ,+ 

r,g,a,y,t 


(a,  y) :  (r  +  1,  g,  a,  y)  e  TLPFLOW 


P  l(19a) 

‘  r  +  l,g,a,y,t 


X  X  ^r,gb,g,y,t'^ 

gb:(gb,g)  €  TALLOWy-(’’>y)  ^ 

y  y  P  J  ,  ,>MAN 

2^  ^r  +  l,g,g,y,t  - r,g,t 

g'-(g',g)  e  TALLOWy-  (’’  +  ><y)  «  YPROM 

's/r,g,t^ 


X  g,  "y",  3>,  /  +  +  7,  g,  "v",  y,  " 

s 

PVSEP  X 

g  yy:{r,y)  e  YV 

\fE4<r^5,  y:(r,y)  e  YV, 


g  y:(r,y)  e  YV 

yE4<r^5,  t>3 


PERr.,^^  I 

^  ('■.j)  G  YER 

V£5<r^7,  y.-fr,);;  e  YER,  t>3 


g,"s",y,t'^  ^r  +  J,g,"s",y, 
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2  S  2 

r  y:(r,y)  e  YEXigb,g)  e  TALLOW 

S  S  X 

r  y:{r  +  l,y)  e  YPROM{g,g')  £  TALLOW 

Vf>5 


^r.7, =  7’OrAL, 


(24) 


X  X  E„g„g  .^.y  ^<E9R3  fort=3,4only  (25) 

^  26<y<29 


E8<r<E9y:{r,y)  e  YEX(g,g')  e  TALLOW 


^r,g,  g',y,t 


X  X  ^"E9'',  g,  g',  y,  t 

y:(E9,y)  £  YPROM{g,g')  £  TFROM 

\/t>3 


TOPx 


TOTALf 


(26) 


^UNDER,,g.  UMANt\ 

g 

t=3,4 


X  X  ^"E9",g,g\y,t 

(g,g')  £  T ALLOW y:{"E9'',y)  £ 


(27) 


Equation  Definitions: 

(1)  Initialize  personnel  levels  (both  E  and  F  variables)  for  first  period. 

(2)  Fix  enlistment  totals  for  years  3  to  6. 

(3)  Distribute  contract  options  for  enlistees. 

(4)  Ensure  the  appropriate  losses  of  new  enlistees  from  initial  boot  training,  for  each  contract  op¬ 

tion. 

(5)  Of  the  personnel  that  the  model  takes  in  as  enlistees,  ensure  the  appropriate  proportion  of  per¬ 

sonnel  survive  into  the  next  period.  Survival  is  defined  as  not  being  attrited  or  promoted. 

(6)  Link  initial  contract  personnel  to  associated  variable  that  tracks  years  of  service  and  movement. 

(7)  Link  initial  contract  personnel  to  associated  promotion  variable  that  tracks  years  of  service  and 

movement. 

(8)  Balance  equations  for  state  r,g,y,f.  (The  number  of  personnel  in  rate  r,  located  in  area  g,  with  y 
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years  of  service,  at  the  end  of  period  f). 

(9)  Account  for  attrition  losses  ‘T  for  all  those  personnel  not  being  tracked  over  their  initial  obli¬ 

gations. 

(10)  Ensure  new  recruits  comprise  some  minimum  percentage  of  total  E-4  and  below  manning. 

(11)  Match  billets  to  available  bodies.  Account  for  under  and  over  manning. 

(12)  Limit  the  number  of  promotions  to  be  no  more  than  some  percentage  of  the  rate  population. 

(13)  Ensure  a  minimum  percentage  of  each  rate  selects  for  promotion. 

(14)  Distribute  promotions  over  years  of  service. 

(15)  Distribute  those  accessions  that  make  it  through  initial  training  over  all  geographic  areas. 

(16)  Ensure  a  minimum  percentage  of  personnel  transferred  out  of  area  gb  go  to  area  g  . 

(17)  Ensure  a  maximum  percentage  of  the  total  transferred  out  of  area  gb  go  to  area  g  . 

(18)  Limit  the  number  of  transfers  out  of  area  g  as  a  proportion  of  the  total  number  of  personnel 

with  rate  r,  during  period  t. 

(19)  Distribute  all  losses  over  geographic  areas. 

(20)  Meet  minimum  manning  requirements. 

(21)  Distribute  voluntary  separations  by  years  of  service. 

(22)  Limit  voluntary  separations  to  maximum  authorized. 

(23)  Distribute  early  retirements  by  years  of  service. 

(24)  Meet  total  manpower  requirements. 

(25)  Limit  the  number  of  E-9’s  separated  (for  periods  3  and  4  only). 

(26)  Limit  the  number  of  E-8’s  and  E-9’s  to  a  proportion  of  the  total  enlisted  force. 

(27)  Limit  the  undermanning  of  E-9’s  to  a  fixed  percentage  of  the  total  E-9  population,  (periods  3 

and  4  only). 

For  TAPLIM/FPS,  the  right  hand  side  (RHS)  structure  becomes  invariant  from  pe¬ 
riod  7  onward  as  manning  requirements  stabilize.  The  equations  and  their  coefficients  be¬ 
come  invariant  from  period  9  onward.  This  allows  the  formulation  to  be  a  candidate  for  the 
application  of  LPoo  techniques  to  evaluate  the  potential  influence  of  either  steady  state  force 
levels,  or  growth  from  period  10  onward  on  the  optimal  decisions  made  in  the  early  periods. 
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D.  TAPLIM/FPS  AS  AN  INFINITE  HORIZON  PROBLEM 

TAPLIM/FPS,  when  defined  over  an  infinite  horizon,  exhibits  the  single  period 


overlap  staircase  structure: 

oo 

.  .  t  ^  3 

Minimize  cXq  -t-  a  cx^ 

t  =  9 

Subject  to: 

^0^0 

=  s 

HXq  +AXg 

=  b 

{1) 

KXg  +AXjq 

=  b 

(2) 

KXk_i  +Ax^ 

=  ft(i  +  P) 

(k) 

Kx, 

+AXk^l 

=  6(i  +  P)^ 

(k^l) 

x^>0 

{t=0,9,10,...) . 

It  is  important  to  note  that  the  variables  associated  with  periods  2-8  of  the  TAPLIM  model 
are  contained  in  the  variable  JCo  since  the  matrix  and  right  hand  side  coefficients  are  not 
invariant  (i.e.,  are  not  the  same  from  period  to  period)  until  period  9.  The  eventual  invari¬ 
ance  in  the  coefficient  matrix  structure  allows  the  implementation  of  the  dual  and  primal 
equilibrium  approximation  methods  to  bound  the  problem.  Also  note  the  invariant  right 
hand  side  is  equivalent  to  assuming  that  once  stabilizing  steady  state  manning  require¬ 
ments  (these  actually  become  invariant  after  period  7),  they  remain  constant  until  some 
period  k.  At  period  k,  it  is  possible  to  introduce  an  exponential  growth  (or  decay)  of  (i+P) 
on  the  RHS,  as  long  as  (7+P)a<L 
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1.  Dual  Equilibrium  Formulation 

The  dual  equilibrium  approximation  aggregates  all  the  constraints  from  period 
(where  it=first  period  of  exponential  decay/growth,  if  used)  onward  with  an  a  discount  fac- 

oo 

tor  and  substitutes  JCj-  =  X  ^  .  The  resulting  reformulation: 

t  =  T 

T-1 

^  —  3  T  ^  3 

Minimize  cXq  +  ^  a  cx^  +  a  cxj, 
t  =  9 

Subject  to: 


^0^0 

HXq+  AXg 

KXg+  AXjq 

KXip  2^ 

=  s  (0) 

=  bj  (7) 

=  b2  (2) 

=  b^_j  {T-1) 

Kxj._j+ 

(aK  +  A)Xj, 

brp 

7-  (7  +  p)a^  ^ 

Xf>0, 

{t=0,9,10....). 

Xt  =  X  includes  appropriate  slack/surplus  variables. 

t  =  T 

bj=b  for  j<k  where  k=  first  period  of  exponential  decay/growth. 

bj=b(l+^y'^  where  k=  first  period  of  exponential  decay/growth,  k<j<T. 

The  implementation  of  constraints  associated  with  period  T  depends  on  the  row 
structure  of  K,  A,  and  b.  For  the  following  sections,  k\  and  correspond  to  row  i  vectors 
of  K  and  A  respectively. 

a.  Constraints  For  Which  k^=0 

All  the  TAPLIM/FPS  constraints  with  the  exception  of  the  flow  balance  and 
loss  factor  constraints  fit  into  this  category  (constraints  3, 4, 6, 7, 10, 11, 12, 13, 14, 15, 16, 
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17, 18, 19, 20, 21,  22, 23, 24, 26,and  27).  Implementation  of  the  dual  equilibrium  approx¬ 
imation  method  needs  to  simply  adjust  the  right  hand  side  of  these  constraints.  For  con¬ 
straints  with  a  non-zero  right  hand  side  (1 1, 20, 22, 24,  and  26),  this  involves  changing  the 

right  hand  side  for  period  Tfrom  b,  to  .  The  revised  constraints  follow: 


X  X  ^r,gb,g,y,T' 

gb:(gb,g)  e  T ALLOW y :  {r,y)  e  YEX 

X  X  +  /,  g',  g,y,T'^ 

g':  {g\g)  e  TALLOW y:  {r,y)  e  YPROM 

BILLET^  j 

UNDERrgT-OVER^gT  = 

Where  k=first  period  of  p  growth/decay 
BILLET^  g  j.  =  BILLET^  g  + 

'^r,g 


(lid) 


X  X  ^r,gb,g,y,T'^ 

gb:igb,g)  €  TALLOW ^ 


^  MAN^,g,T 


X  X  ^r  +  l,g',g,y,T- ]  _  + 

g':(.g',g)  sTALLOWy:(r  +  I,y)  e  YPROM  '■ 

Where  k=first  period  of  p  growth/decay 


(20d) 


=  MAN  g{l  +  ^) 


VMAK^j 

X  X  g,  "v",  3^,  r  +  +  7.  g,  "v",  j.  (/  +  3)a 

^  3-.  (r,3’)eyV 

Where  k=first  period  of  P  growth/decay  (22d) 

VMAX^  j,  =  VMAX^^ 9  (f  +  P) 

\/E4<r^5 
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E8<r<E9y:{r,y)  €  YEX{g,g')  €  TALLOW 


X  S  ^"E9",g,g',y,T 

y:(E9,y)  e  YPROM(g,g')  e  TALLOW 

Where  k=first  period  of  P  growth/decay 


TOPx  TOTALj 
7  -  (7  +  P)  a 


T-k 

Total  j.  =  Total  g  ( 7  +  P) 


(26d) 


If  the  right  hand  side  h=0,  (constraints  2,  3, 4,  6,  7,  11,  13,  14,  15,  16,  17,  18,  19,  20,  22, 
24,  and  28),  then  the  constraints  associated  with  period  T require  no  adjustment  for  imple¬ 
menting  dual  equilibrium. 

b.  Constraints  for  which 

This  structure  holds  for  the  flow  balance  constraints  and  loss  factor  adjust¬ 
ment  constraints  of  TAPLIM/FPS  (constraints  5, 8, and  9).  In  this  case,  the  effected  con¬ 
straints  must  reflect  adding  the  factor  aKxj  in  period  T: 


TOSc  y  T  +  JP^O^c,y,  jiwhen  CE5*\y)  €  YPROM)  =  PTOS^  ^  X  TOS^  y_ 

PTOS^^^xaTOS^^_,j 

\/c,  (E4.y,T)  e  YTOS 


(5d) 
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z 

gb:(gb,g)  e  TALLOW 
for  (r,  y-J)€  YEX 

( 


^r,gb,g,y-l,T-l'^  ^  ^r,g',g,y  -  1,T  - 1 

g':(g\g)  e  TALLOW 


I 

)  6  TA 
for{r,y-l)  €  YPROM 

I 


“  X  ^r,gb,g,y-l,T^  Ld  ^  r  +  l,g\g,y-l,T 

gb:  (gb,  g)  €  TALLOW  g':  (g',  g)  e  TALLOW 

V  for(r,y-l)£  YEX  for  (r  + 1,  y  -  ^  YPROM 


(8d) 


X  ^r,g,a,y,T^  X  ^r  +  l,g,a,y,T 

a:  (r,  g,  a,  y)  e  TTOLE  a:  (r,  g,  a,  y)  e  TTOLE 

for  (r,  y)  e  YEXS  for  (r-¥l,y)£  YPROM 

'^r,g,y 


^  r,g,'T,y,T  r  +  l,g,'T,y,T 


for  {r,  y)  e  YEXS  for  [r  +  l,y)  e  YPROM 
f 

I 


NLOSS  X 
r,y-l 


^r,g\g,y-l,T-l  + 


g':(g\g)  €  TALLOW 


f 


a 


for  (r,y~  1)  e  YEX 

'  I 

g’.-ig'.g)  e  TALLOW 
for(r,y-I)  e  YEX 

'^gAr.y.t)  e  NOTYTOS 


I 

g':(g\g)  €  TALLOW 
for(r,y-})  e  YPROM 


^r,g\g,y-l.T-l 


NLOSS  X 
r,y-l 


V 


^r,  g\  g,y-LT'^ 


X  Tr,g\g,y-LT 

g':  (g\g)  e  TALLOW  j 

for  {r,y  - 1)  e  YPROM 


J 

W 


(9d) 


2.  Primal  Equilibrium  Formulation 

The  primal  equilibrium  approximation  for  TAPLIM/FPS  adds  the  restriction 
^t+i=(l+P)^t>  (i+p)a<i).  The  finite  period  re-formulation  for  7^  (where  fc=  first 

period  of  exponential  growth/decay  when  used)  is: 
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r-7  r-5 

Minimize  1-  (1  +  ^) 

II 

Subject  to: 

=  s 

(0) 

HXq+  AXg 

= 

(1) 

KXg+  Ax  IQ 

=  b, 

(2) 

KXt_j+  Axj, 

=  bj, 

(T) 

Kxj,+  AXj.  ( -/  +  P) 

~  ^T+l 

(T+l) 

bj=b  for  j<k  where  k=  first  period  of  exponential  decay/growth. 
bj=b(l+^y'’^  where  k=  first  period  of  exponential  decay/growth,  k<j<T. 

a.  Adjusting  the  Objective  Function 

Adjustment  of  the  objective  function  is  easily  done  by  multiplying  all  period 
T  cost  coefficients  by  y  _  ^  ’ 
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Minimize 

( 


T-l 

S“ 

t  =  3 


-3 


( WOVER^^  gOyER^  ^  ^  +  WUNDER^^  UNDER^  g, /)  V 


g  r 
CENLIST 


lENLIST^^  +  c^f  2 

c  y(r,a,"s".y)  e 


E 


TLFLOW 


r,  a,  "s",  y,  t 


a,y  E  X  g,  "v",  j,  f  +  i,  g,  "v",  y, 
ir,y)  eYV  g 


-Vp, 


r,y 


ir,y)  €  YPROM{g,g')  e  TALLOW 


^r,g,g',y,t'^ 


COST 


V  {g,g’)  €  TALLOW 


-J  1 


E, 


r,g.g,y, 


r,g,g\  y,t 


(r,y)  e  YEX 


{r,y)  e  YPROM 


T-3 


7-(7  +  p)a 


YY  (  g,T'^  WUNDER^^  ^UNDER^  j)  + 


g  r 


CENLIST JYfEN LIST J+Cs^  ^  , 


S  ^r,a,  V',j,r 

(r,  fl,  "s'\y)  e  TLFLOW 


+ 


fl,  V  S  X  g,  "v'\  3;,  r  +  +  7,  g.  "v",  3^,  j) 


(r,  y)  eYV  g 


-Vp 

r,: 


(r,  y)  e  YPROM  {g,  g')  e  TALLOW 


^r,g,g’,y,T'^ 


COST 


^  {g.g')  e  TALLOW 


g.g 


X  ^r,g.g',y,T  + 

(r,3-)  e  YEX 


r,  g,  g\y,T 


{r,y)  G  YPROM 


b.  Modifying  the  Constraint  Space 

Like  dual  equilibrium,  the  primal  equilibrium  implementation  of  constraints 

associated  with  period  T  depends  on  the  row  structure  of  K.  If  A:‘=0,  implementation  of  the 
primal  equilibrium  approximation  method  requires  no  change  to  the  constraint  set(s)  asso¬ 
ciated  with  the  truncated  formulation.  All  the  TAPLIM/FPS  constraints  with  the  exception 
of  the  flow  balance  and  loss  factor  constraints  fit  into  this  category  (constraints  2,  3, 4,  6, 

7, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19,20,21,22,23,24, 25,26,and27).  WhenA:'Vo,  which 
holds  for  the  flow  balance  and  loss  factor  constraints  (constraints  5, 8,  and  9),  an  additional 
constraint  set  must  be  added  to  reflect  the  ties  created  by  the  cut  Xj(7+P)=Xj+  j.  These  addi¬ 
tional  constraints  are  listed  below: 
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=  PTOS^,,xTOS^^_,j. 

Vc,(E4,y,T)e  YTOS 


(5p) 


X 

gb:{gb,g)  €  TALLOW 
for{r,y-l)  e  YEX 


^r,gb,g,y-l,T'^  Zj  ^  r,g\g,y-l,T 

g-:(g\g)e  TALLOW 


(^  +  P) 

'^r,g,y 


z 

a:(r,g,a,y)  e  TTOLE 
for{r,y)  €  YEXS 


X 

I  e  T 

for  {r,y  - 1)  e  YPROM 

X 

.3')  G 

for(r  +  l,y)  s  YPROM 


\ 


^r,g,a,y,T'^  Zu  *r  +  l,g,a,y,T 

(/*,  gi  3^)  ^  TTOLE 


(8p) 


(i  +  P) 


^  r,g/r,y,T  r  +  7,f."r,3-,r 

/O'-  (z-.  J)  6  for  (r  +  l,y)e  YPROM J 


NLOSS^  y_jX 


Z  ^r,g\g,y-l,T'^  Z  ^r,g\g,y-l,T 

g':  ig\g)  €  TALLOW  g':  {g\  g)  e  TALLOW  y 


for  (r,  y  -  J)  €  TLX 

Vg,(r,3;,7;  e  NOTYTOS 


for(r,y-I)  e  YPROM 


(lOp) 


E.  EXAMINING  THE  IMPACT  OF  END  EFFECTS  ON  TAPLIM/FPS 

The  initial  runs  of  TAPLIM/FPS  consist  of  using  the  truncated  formulation  with 
data  provided  by  ODCSPER  (i.e.,  FY-92  to  FY-99,  with  stability  in  all  coefficients  occur¬ 
ring  in  year  FY-99),  then  comparing  these  results  with  the  dual  and  primal  equilibrium  ap¬ 
proximations  of  the  infinite  horizon  model  with  manning  set  to  FY-99  steady  state  levels 
from  FY-99  to  infinity,  (i.e.,  no  growth  or  decay  of  manning  or  billet  requirements,  P=0). 
Table  1  provides  a  comparison  of  optimal  objective  function  values  for  the  truncated,  dual, 
and  primal  equilibrium  approximations  over  the  solution  horizon  FY-92  to  FY-99. 
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Dual  Equilibrium 
Approximation 

Primal  Equilibrium 
Approximation 

Truncated  Approximation 

4379 

Infeasible 

2637 

Table  1. 

Comparison  of  Optimal  Objective  Function  Values  for  TAPLIM/FPS 


Because  TAPLIM/FPS  encompasses  9  geographic  areas  and  6  rate  classes  for  each 
time  period,  the  8  period  models  (FY92  -  FY99)  are  large  (approximately  59,496  variables, 
16,856  constraints  for  each  formulation).  Initial  tests  generating  the  model  using  the  Gen¬ 
eral  Algebraic  Modeling  System,  GAMS,  (Brooke,  Kendrick,  and  Meeraus,  (1992))  with 
solvers  XA  (Sunset  Software  Technology,  (1993))  and  OSL  (IBM  Corporation,  (1991))  re¬ 
quire  in  excess  of  24  IBM  RS-6000  Model  590  CPU  hours.  In  addition,  the  primal  equilib¬ 
rium  method  requires  a  longer  solution  horizon  to  satisfy  feasibility.  This  made  the  model 
impractical  for  examining  longer  time  horizon  dual  and  primal  equilibrium  approxima¬ 
tions. 

F.  TAPLIM 

In  comparing  the  results  of  baseline  runs  of  TAPLIM/FPS,  to  baseline  runs  of 
TAPLIM  without  FPS  (i.e.,  eliminate  tracking  personnel  by  geographic  area),  the  accession 
and  promotion  levels  are  similar  for  both  models.  An  explanation  of  this  similarity  lies  in 
the  coarseness  of  the  coefficient  data  provided  by  the  United  States  Army  to  drive  the  mod¬ 
el.  Both  the  promotion  and  attrition  rate  data  are  dependent  only  on  years  of  service,  there¬ 
fore  geographic  location  has  only  a  minor  influence  on  the  results  (maintaining  feasible 
numbers  of  personnel  in  each  geographic  area  and  feasible  transfer  flows).  The  key  deci¬ 
sions  of  interest  (number  of  accessions  required,  number  of  promotions,  number  of  invol¬ 
untary  separations,  number  of  voluntary  separations)  can  still  be  addressed  effectively 
without  the  FPS  extension.  This  dissertation  uses  TAPLIM  without  FPS  to  fully  examine 
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end  effects.  To  use  TAPLIM  without  FPS,  the  following  modifications  to  TAPLIM/FPS 
are  made: 

1.  Indices 

The  following  are  indices  modifications: 

a  transfer  areas  (boot  camp  (b),  active  duty  (j:),  involuntary  separation 
(i'),  voluntary  separation  (v),  normal  attrition  losses  either  by 
discharge  or  retirement  (/)); 
gb  Active  duty  plus  boot  camp  (x,  b); 
g  Active  duty  only  (x). 

2.  Derived  Sets 

The  following  are  modified  sets: 

TALLOW  Set  of  allowable  areas  {gb,g')  soldiers  can  transfer  between 
(includes  transfers  from/to  the  same  area  {g,g)). 

(Modified  to  be  only  (Z>,x),  {x,x)  .); 

TTOLE  Set  of  allowable  (r,  gb,  a,  y)  for  soldiers  not  selected  for 

promotion  during  the  period.  This  includes  loss  areas. 
(Modified  to  reflect  that  active  duty  is  the  only  geographic 
area); 

TTOLP  Set  of  allowable  (r,  g,  a,  y)  for  soldiers  selected  for 

promotion  during  the  period.  This  includes  loss  areas. 
(Modified  to  reflect  that  active  duty  is  the  only  geographic 
area). 
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The  following  sets  are  eliminated: 

PCS  Set  of  allowable  geographic  areas  (g,g')  for  which  PCS 

transfers  between  are  possible. 

3.  Data. 

The  following  data  changes: 

BILLET^  g  t  Number  of  billets  requiring  rate  “r”  for  area  “g”  for  each 

period  “t”.  (Modified  to  Billet^  t 

g 

MANj.  g  f  Minimum  number  of  personnel  with  rate  “r  ”  that  must  be 
assigned  to  area  “g”  for  each  period  “t”.  (Modified  to 
=  YMAN^y, 

g 

The  following  data  sets  are  eliminated: 

PACCg  Minimum  proportion  of  accessions  assigned  to  geographic 

area  “g”  for  each  time  period; 

PPCS^ g  g<  Minimum  proportion  of  transfers  out  of  area  “g ”  that  must 
go  to  area  “g' 

PPCS  j.gg>  Maximum  proportion  of  transfers  out  of  area  “g  ’’that  can  go 
to  area  “g' 

TPCSr  g  Minimum  proportion  of  area  force  total  with  rate  “r”,  that 

can  PCS  out  of  area  “g  ”  for  each  time  period; 

PLQSS^  g  Assign  a  minimum  proportion  of  total  rate  “r”  losses, 

to  area  “g”; 

Floss  ^  g  Assign  no  more  than  proportion  of  total  rate  “r  ”  losses,  that 
can  be  assigned  to  area  “g”; 

COSTg  g’  Cost  of  PCS  transfer  from  area  g  to  area  g' . 
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4.  Modified  Formulation 

The  following  reflects  the  modified  formulation  using  the  original  constraint  num¬ 
bers  with  only  one  geographic  area  to  represent  personnel  on  active  duty.  Constraints  16- 
19  linked  specifically  to  the  geographic  transfer  flow  network  are  eliminated.  Please  note 
that  the  modifications  for  the  primal  and  dual  equilibrium  approximations  described  above 


still  apply. 

Objective  Function  (modified  by  dropping  costs  linked  to  geographic  transfer 

flows): 

Minimize 

(WOVER  OVER^  „  ,  +  WUNDER  UNDER  „  P  1  + 

r,g  r,g,t  r,g  r,g,i 

1 


1“ 

f  =  5 


t-3 


g  r 

CENUST^Yi^NLIST^^  ^  ^  , 


(!■,«,"/»  e  TLFLOW 


^r,a,"s",y,t 


Cv 


r,  a,y 


S  S  (  g,  W,  3-,  t  +  i,  "v", 


(T,y)  e  YV  g 


I  '^Pr,y  X  X  ^r,g,g',y,t  j 

^  (r,y)  e  YPROM{g,g')  €  TALLOW 


Constraints: 

8 

I  =  Edata,^^\/ir,y)  eYEX  (1) 

(g,g^)  e  TALLOW 


X  Er,g,g',y,2  -  Pdata^  y 

g,g’e  TALLOW 

for(r,y)=(E5,3),  (E6,5),  (E7,ll),  (E8,16),  (E9,18) 


(la) 


Y^ENLIST^^  =  NACC^ 

c 

for  3<t^ 


(2) 
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ENLIST^  ^  >  PTERM^  ^  x  '^ENLIST^  , 

C 

\/c,t>3 


TOS^,,q„^  =  PTOS^  .q.  fXENLIST^^ 


tos,,,+iprom^^, 


=  pros,  .xTos 

y 


\,y-ut-l 


Vc,  t^,  (E4,y,t)  G  YTOS 


(5) 


'Xi^"E4",b,g,y,t  - 
g  ^ 

yt>3 


(6a) 


2  ^"E4'’,g,g\y,t  -  Yj^^c,y,t 

{g,  g’)  €  TALLOW  c 

y(E4,y,t)  €  YTOS, 


(6b) 


S  ^"E5",g,g\y,t 

(g,g')  e  TALLOW 

\/(E4,y,t)  G  YTOS  t>3 


=  J^IPROM^^, 

C 


(7) 


5](  gb,g,y-l,t- 1 

gb:{gb,g)  €  TALLOW 

for(r,y-l)  e  YEX 


X  ^r,g\g,y-l,t-l 

g’:(g',g)  e  TALLOW 

for  {r,y  - 1)  e  YPROM 


X  X  ^r  +  l,g,a,y,t 

a:  (r,  g,  a,  j)  e  rrOL£  «.  (r,  g,  a,  y)  e  TTOLE 

for  (r,  3-)  e  YEXS  for  (r  +  7,  j')  €  YPROM 

\/r,g,y,t>3 


(8) 
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^  r  +  l,g,"l",y,t 

for  (r,y)  e  YEXS  for  (r  +  l,y)  e  YPROM 


NLOSS^  y_j  X 


s 

g':(g\g)e  TALLOW 
''  for  (r,  y- 1)  G  YEX 

\/g,(r,y,t)  e  NOTYTOS 


^r,g',g,y- l,t- 1  ^r,g\g,y-l,t-l 

g':(g\g)  e  TALLOW 

for{r,y-I)  e  YPROM 


'Yj^"F4",  "h",  e,  "0",  t  -  PE4i  ^  ^  ^"E4",gb,g,y,t 

g  ^  igb,  g)  6  TALLOWy:  (E4,y)  G  y£Jr 

2  2  P"E5",g,g',y,t 

V  G  TALLOW y:{E4,y)  g  r/>«OM 

\/t^ 


(9) 


(10) 


2  2 

(  gb,g)  G  TALLOWy:  {r,y)  6 

2  2 

(  g.g)  e  TALLOWy:  (r  +  /.j)  e  YPROM 

UNDER^  ^  ^  ,  =  BILLET^  ^  ^ 

'ir^5,t>3 


^r  + 1,  g’,  g,y,t^ 


(11) 


2  2  ^r,g,a,y,t- 

{g,  a) :  (r,  g,  a,  y)  e  TTOLPy:  (r,  y)  g  YPROM 

PRof  X  2 

V  (gb,a):(r-  l,gb,a,y)  e  TTOLEy:  {r- l,y)  e  YEX 

2  2 

{g,  a) :  (r,  g,  a,  j)  e  TTOLPy:  (r,  3-)  g  YPROM 

\/r^5,t>3 


^r-l,gb,a,y,t  ' 


(12) 
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Z  Z  Pr.,.a.,..i 

(S. «) .  (',  *. «,  J)  s  TTOLPy:  (r.y),  YPROM 

V  {gb,  a):(r-l,  gb,  a,  j)  e  TTOLEy:  {r  -l,y)e  YEX  ^ 

I  I  ^r,g,a,y,^ 

V  (g^,  d) :  (r,  g,  a,  y)  e  TTOLPy:  (r,  3-)  €  YPROM  ^ 

\/r^5,t>3 


^  r,g,a,y,t 

(g,  a) :  (r,  g,  a,  3^)  e  rrOLP 

^.,,x  z  z 

’  (g, «)  ••  (»•.  g. «.  J-)  e  7TOLP3-:  (r.  3-)  e  YPROM 

\/r^5,  t>3 


^"E4",  "b",  g,  "0",  t  -  ^A££.g  ^  ^^"E4",  "b",  g,  "C 

g 

\/g=x,  c,  t>3 


X  S  ^r,  gb,  g,y,t'^ 

gb:(gb,g)  e  TALLOWy:(r,y)  e  YEX 

Z  Z  ‘•ryJ.Y., 

g'-(g',g)  S  TALLOWy:('*hy)  e  yPROM 

yr,g,t>3 


yl.S'.y.y.t^^r.Y., 


g 

X  <-Er.g.V.y.,*P,y,.g.-,'.,.,) 
g  ^y--(.r,y)  €  rv 

\/E4<r^5,  y:( r.y)  €  77, 


X  2  g,  "v",  3-,  <  +  +  7,  g,  "v".  3-,  <)  "  < 

g  3-;(r.3)  e 

\/E4<r^5.  t>3 
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(23) 


X  g,  "s",  y,t'^^r  +  l,  g,  "s",  y,  P  “ 

g 

PERr  yX^(  X  ^^r,g,"s",y,t'^  ^r  +  l,g,"s'',y,t^ 
g  ^y-  ir,y)  sYER 

\fE5<r^7,  y:(r,y)  e  YER,  t>3 


XX  X  ^r,gb,g,y,t'^ 

r  y:(r,y)  e  YEX{gb,g)  6  TALLOW 

XX  X  ^r  +  l,g,g',y,t 

r  y:(r  +  l,y)  e  YPROM{g,g')  e  TALLOW 

\/t>3 


=  TOTAL^ 


(24) 


^  ^  E»g„^  g  f  <  E9R3  for  t=3,4  only 

g  26<y<29 


(25) 


XX  X 

E8<r<  E9y:  (r,  y)  e  YEX  (g,  g')  e  TALLOW 

X  X 

y:(E9,y)  e  YPROM{g,g')  e  TALLOW 

\/t>3 


^r,g,  g', 


E"E9",g,g',y,t  -  TOPx  TOTALt 


(26) 


\UNDER„g„  ^  <  UMANt  ^  X 

^  ’’  (g,g')eTALL0Wy:CE9",y)eYEX 

t=3,4 


^"E9",g,g\y,t 


(27) 


The  original  TAPLM/FPS  formulation  should  be  used  if  data  can  be  pro¬ 
vided  which  breaks  down  promotion/attrition  rates  by  rate  and  years  of  service  and  geo¬ 
graphic  area,  and  if  these  rates  are  significantly  different  between  geographic  areas  for  at 
least  some  rate  and  year  combinations.  However,  given  the  data  provided,  the  reduced 
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model  is  sufficient  to  analyze  the  impact  of  end  effects  on  the  key  decision  variables  of  in¬ 
terest  (total  accessions,  total  promotions  by  years  of  service  for  each  rate,  total  voluntary 
and  involuntary  separations  by  rate  and  years  of  service,  and  deviations  from  satisfying  ac¬ 
tive  duty  manning  requirements). 

G.  ANALYSIS  AND  RESULTS 

This  section  highlights  the  results  obtained  when  applying  primal  and  dual  equilib¬ 
rium  approximations  to  TAPLIM.  The  first  section  looks  at  an  infinite-horizon  extension 
of  the  truncated  formulation  that  assumes  steady  state  FY-99  year  manning,  from  FY-99  to 
infinity,  using  a  0.9  discount  factor.  Truncation  end  effects  impact  both  the  accession  and 
promotion  decision  variables.  It  is  shown  that  the  primal  and  dual  equilibrium  approxima¬ 
tions  generate  a  tight  bound  on  the  infinite-horizon  optimal  solution  and  both  primal  and 
dual  equilibrium  approximations  effectively  eliminate  the  end  effects.  The  second  section 
examines  the  impact  of  primal  and  dual  equilibrium  approximations  to  capture  end  effects 
when  the  discount  factor  a  varies.  The  choice  of  a  does  impact  the  optimal  decisions,  how¬ 
ever,  even  with  oc  set  to  a  relatively  low  value  of  oc=0.5,  end  effects  found  when  using  only 
a  finite  horizon  are  eliminated.  Sections  three  through  seven  examine  the  variability  of  the 
initial  optimal  accession  decisions  obtained  from  the  zero  growth  model,  under  conditions 
of  growth  in  future  periods.  Section  eight  uses  algorithm  (see  Chapter  V),  and  it 

proves  highly  effective,  generating  a  tight  upper  bound  on  the  error  associated  with  using 
the  optimal  accession  decisions  derived  under  the  zero  growth  assumption,  when  moderate 
growth  occurs  in  future  periods.  In  all  cases,  solution  run  times  are  quite  reasonable.  Tests 
using  the  model  generator  GAMS  with  solver  OSL,  running  on  an  IBM  RS-6000,  generated 
optimal  solutions  using  between  2  (dual  equilibrium,  7  year  horizon),  and  7  CPU  minutes 
(primal  equilibrium,  29  year  horizon). 
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1.  Analysis  and  Results,  Zero  Growth  (p=0,  a=0.9) 


a.  Convergence  of  Dual/Primal  Equilibrium  Objective  Funo 
tion 

Figure  21  illustrates  the  convergence  performance  of  the  primal  and  dual 
equilibrium  objectives  as  the  solution  horizon  is  varied. 


Problem  Horizon 

(1)  Manpower  Requirements  Steady  State  Period  7  onward 

(2)  Problem  Structure  Invariant  Period  9  onward 

(3)  0=0.9 

Figure  21. 

Convergence  of  primal  and  dual  objective  function  values. 

Figure  21  illustrates  that  for  TAPLIM,  both  primal  and  dual  equilibrium  ap¬ 
proximations  converge  to  within  1%  within  1 1  years  after  the  formulation  becomes  invari¬ 
ant.  It  is  also  worth  noting  that  while  dual  equilibrium  is  converging  slower  than  the  primal, 
it  is  a  closer  approximation  to  the  infinite  horizon  optimal  objective  function  value  for  both 
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the  10  and  15  year  problem  horizons.  This  can  be  recognized  given  the  infinite-horizon  op¬ 
timal  solution  must  be  between  524  and  528,  as  determined  from  evaluating  the  primal  and 
dual  equilibrium  approximation  methods  for  a  20  year  horizon. 

b.  Truncated,  Partial  Primal  Equilibrium  and  Dual  Equilibri¬ 
um  Objective  Function  Values 

Table  2  provides  a  comparison  of  period  2  through  9  optimal  objective  func¬ 
tion  values  obtained  from  a  2  to  9  period  TAPLIM  formulation,  and  dual/primal  partial  ob¬ 
jectives  obtained  from  the  primal  and  dual  equilibrium  solutions  over  a  19  year  horizon 
(periods  2-20). 


Truncated  Objective 
Function 

Partial  Primal  Objective 
Function 

Partial  Dual 

Objective  Function 

469.16 

491.68 

490.31 

Table  2. 

Comparison  of  period  2  to  9  objective  function  values. 


With  no  end  effects  in  the  truncated  formulation,  the  truncated  optimal  ob¬ 
jective  function  value  should  closely  match  the  Primal  and  Dual  Equilibrium  partial  objec¬ 
tive  function  values  over  the  truncated  problem’s  solution  horizon.  As  Table  2  illustrates, 
this  is  not  the  case.  A  gap  of  approximately  5%  exists  between  both  the  primal  and  dual 
partial  objective  function  values  and  the  truncated  objective  function  value.  This  indicates 
that  end  effects  are  potentially  influencing  the  solution  of  the  truncated  problem.  Table  3 
provides  a  comparison  of  the  dual  and  primal  equilibrium  approximation  optimal  solutions 
obtained  when  constrained  to  include  the  optimal  ENLIST variables  of  the  truncated  for¬ 
mulation. 
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Unconstrained 

Constrained 

Difference 

Primal  Equilibrium 

528.067 

565.575 

37.508  (7%) 

Dual  Equilibrium 

524.284 

538.480 

14.196  (3%) 

Table  3. 


Comparison  of  primal  and  dual  equilibrium  approximations. 

The  constrained  version  has  the  value  of  Enlist^  ^  set  to  the  optimal  truncated  solution. 

As  Table  3  illustrates,  the  optimal  accession  choices  of  the  truncated  formu¬ 
lation  are  feasible,  but  sub-optima  for  both  the  primal  and  dual  equilibrium  approximations. 
Given  the  infinite  optimal  objective  function  value  lies  between  the  primal  and  dual  objec¬ 
tive  function  values  (524.284, 528.067),  it  is  clear  that  the  truncated  decisions  are  feasible, 
but  sub-optimal,  since  the  best  possible  infinite  horizon  objective  function  value  using  the 
truncated  formulation  decisions  is  538.480,  yet  the  infinite  optimal  lies  at  or  below 
528.067.  End-effects  are  influencing  the  choices  made  by  the  truncated  formulation. 

c.  Examining  Accession  Decision  Variables  (ENLIST 

Given  that  end  effects  are  influencing  the  accession  decision  variables,  the 
next  goal  is  to  try  to  determine  how  these  variables  are  being  influenced  by  end  effects,  and 
then  to  determine  whether  solutions  derived  from  Dual  and/or  Primal  Equilibrium  approx¬ 
imations  effectively  minimize  or  eliminate  this  influence.  Tables  4-6  provide  the  optimal 
decision  variables  (periods  1 5  -  20)  generated  by  a  20  period  truncated  formulation,  a  20 
period  dual  approximation,  and  a  20  period  primal  approximation. 
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Contract  Length 


Time  Period 


15 

16 

17 

18 

19 

20 

2 

7.50 

6.88 

6.87 

6.93 

16.01 

15.69 

3 

10.62 

9.75 

9.73 

9.82 

9.72 

9.53 

4 

26.86 

24.66 

24.60 

24.83 

24.59 

24.10 

5 

3.75 

12.62 

12.59 

12.70 

;3.36\";;^ . 

6 

13.74 

3.44 

3.43 

3.46 

^3.43 

■3.36  ^  1;''' 

Table  4. 


Enlistments  by  contract  type  and  time  period. 
Truncated  model  with  20  year  horizon,  periods  15-20. 


■S 

W) 

G 

ts 

G 

O 

U 


Time  Period 


15 

16 

17 

18 

19 

20  (Note  1) 

2 

1.24 

6.88 

6.77 

6.93 

6.80 

71.28 

10.25 

9.74 

9.59 

9.82 

9.63 

100.98 

4 

25.93 

24.64 

24.26 

24.84 

24.36 

255.42 

5 

4.92 

3.14  , 

3.3^,, 

3.47- -v. 

3.40 

68.72 

6 

11.97 

l|61 

12.41 

■12.71%; 

.12:46 

97.60 

Table  5. 


Enlistments  by  contract  type  and  time  period. 

Dual  equilibrium  model  with  20  year  horizon,  periods  15-20, 

(Note  1:  Period  20  represents  aggregated  discounted  sum  periods  20  to  «>) 
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Table  6. 


Enlistments  by  contract  type  and  time  period. 

Primal  equilibrium  model  with  20  year  horizon,  periods  15-20. 


The  model  intuitively  should  seek  to  hire  as  many  five  and/or  six  year  con¬ 
tracts  as  possible,  since  the  model  seeks  to  minimize  accessions  and  the  attrition  loss  rates 
for  the  five  and  six  year  enlistees  are  less  than  any  other  contract.  Promotions  also  play  a 
role,  as  most  E4s  promote  to  E5  at  the  4  and  5  year  point,  and  once  an  E4  becomes  an  E5, 
the  attrition  rate  decreases.  Side  constraints  keep  the  model  from  assigning  all  enlistees  to 
5  and  6  year  contracts  as  the  number  of  enlistees  in  each  contract  length  must  account  for 
some  minimum  percentage  of  total  enlistees.  As  the  final  hiring  period  approaches,  the 
truncated  model  no  longer  needs  to  minimize  future  period  attrition  (and  therefore  the  need 
to  input  a  greater  number  of  accessions).  This  influences  the  6  year  contract  length  vari¬ 
ables  as  early  as  year  16  (Table  4).  Examining  both  the  dual  and  primal  equilibrium,  it  is 
apparent  that  primal  and  dual  equilibrium  approximations  successfully  capture  the  influ¬ 
ence  of  this  end  effeet  (Tables  5  and  6).  It  is  important  to  note  that  this  end  effect,  in  and  of 
itself,  does  not  appreciably  impact  the  truncated  objective  function  value.  There  are  no  dif¬ 
ferentiated  costs  between  contract  types  for  enlistees,  only  costs  associated  with  the  total 
number  of  enlistees.  The  costs  associated  with  this  end  effect  are  most  likely  tied  to  promo¬ 
tion  levels  to  E5  and  above,  as  these  levels  are  heavily  influenced  by  accession  policy.  It 
may  also  be  possible  that  this  end  effect  is  partially  the  result  of  the  existence  of  multiple 
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optimal  solutions  in  the  truncated  formulation,  that  are  sub-optimal  over  longer  time  hori¬ 


zons. 


d.  Examining  Promotions 

Selection  for  promotion  to  the  next  higher  rate  is  driven  by  the  objective 
function  and  by  end  effects.  Tables  7-9  provide  a  listing  of  selections  for  promotion  to  E-5 
by  years  of  service,  from  period  15-20,  for  the  truncated,  primal,  and  dual  equilibrium  ap¬ 
proximations: 


Time  Period 


15 

16 

17 

18 

19 

3 

9.752 

10.430 

9.330 

11.637 

8.622 

ibKI 

4 

6.339 

6.779 

6.739 

7.564 

6.227 

5 

6.339 

6.779 

7.775 

7.564 

6.227 

12.967 

6 

1.463 

1.564 

1.555 

1.746 

2.395 

12:992^  ' 

7 

0.244 

0.261 

0.259 

0.291 

0.239 

8 

0.244 

0.261 

0.259 

0.291 

0.239 

0.499 

Table  7. 


Promotions  by  years  of  service  to  E5,  periods  15-20. 
(Truncated  Model) 
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Table  8. 

Promotions  by  years  of  Service  to  E5,  periods  15-20. 
(Dual  equilibrium  model) 


Table  9. 

Promotions  by  years  of  Service  to  E5,  Periods  15-20 
(Primal  equilibrium  model) 

Examining  time  period  20  of  the  truncated  model  (Table  7)  it  is  clear  that 
the  model  is  under  promoting  in  periods  15, 17,  and  19,  (when  compared  to  primal  and  dual 
equilibrium)  and  heavily  over-promoting  in  year  20.  This  end  effect  is  most  likely  caused 
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by  both  the  lack  of  manpower  requirements  for  follow-on  years  and  the  objective  function 
seeking  to  maximize  promotions.  The  optimal  promotion  levels  from  the  primal  and  dual 
equilibrium  approximations  are  stable  over  the  last  five  years.  (It  is  important  to  note  that 
year  20  of  the  dual  equilibrium  approximation,  Table  8,  is  the  discounted  sum  of  promo¬ 
tions  from  year  20  onward.  The  per  year  average  is  approximately  1-a  times  the  value  list¬ 
ed).  Dual  and  primal  equilibrium  approximations  appear  to  minimize  the  impact  of  this  end 
effect. 

2.  Impact  on  Zero  Growth(p=0),  When  a  Varies 

The  scalar  a  directly  impacts  the  relative  value  of  future  decisions  on  the  objective 
function  value  for  both  the  primal  and  dual  equilibrium  approximations.  Therefore,  deceas¬ 
ing  the  value  of  a  decreases  the  importance  of  future  periods  and  hence  the  likelihood  that 
end  effects  will  pose  a  serious  problem.  For  TAPLIM,  this  intuitive  result  holds  true.  To 
illustrate  the  truncated,  dual  equilibrium,  and  primal  equilibrium  models,  with  a  varied 
(0=0.5,  0=0.95)  are  solved  for  a  20  year  time  horizon.The  variables  reflecting  the  optimal 
number  of  enlistees  by  contract  length,  from  the  15  -  20th  period  are  examined.  Tables  10 
- 12  summarize  the  results  for  o=0.5,  and  Tables  13-15  summarize  results  for  o=.95. 


Time  Period 

Contract  Length 

15 

16 

17 

18 

19 

20 

2 

8.36 

6.78 

6.54 

7.28 

15.66 

15.13 

3 

11.85 

9.61 

9.26 

10.32 

9.51 

9.19 

4 

24.30 

23.43 

26.10 

24.05 

23.24 

5 

4.18 

■iiii 

3.2l:'-i . 

6 

11.99 

13.36 

3.36||:^ 

.3.24  ,,,/■■  . 

Table  10. 

Enlistees  by  contract  length,  periods  15-20 
(Truncated  model,  0=0.5) 
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Contract  Length  I  I  Contract  Length 


Time  Period 


15 

16 

17 

18 

19 

20 

2 

8.36 

7.25 

6.71 

14.56 

3 

11.85 

9.62 

9.31 

10.27 

9.51 

20.63 

4 

29.97 

24.32 

5 

4.18 

12.44 

12.05 

3.63 

26.69 

6 

15.33 

3.39 

3.29 

13.29 

3.36 

7.28 

Table  11. 


Enlistees  by  contract  length,  periods  15-20. 
(Dual  equilibrium  model,  (X=0.5) 


Time  Period 


15 

16 

17 

18 

19 

20 

2 

17.10 

6.98 

10.57 

10.57 

3 

11.76 

9.89 

10.48 

10.48 

10.48 

10.48 

4 

29.85 

25.03 

26.51 

26.51 

5 

6.32 

12.60 

10.38 

6 

4.15 

3.70 

3.70 

3.70 

3.70 

3.70 

Table  12. 


Enlistees  by  contract  length,  periods  15-20. 
(Primal  equilibrium  model,  a=0.5) 


Contract  Length  I  I  Contract  Length 


Time  Period 


15 

16 

17 

18 

19 

20 

2 

7.77 

6.85 

6.86 

6.81 

16.16 

15.68 

3 

11.01 

9.70 

9.72 

9.65 

9.81 

9.52 

24.59 

24.40 

24.82 

24.08 

5 

3.89 

12.55 

12.58 

12.48 

^'3.36: . -Vi; 

6 

3.43  , 

'3.40 

3,46'^'’ 

3.36"r 

Table  13. 


Enlistees  by  contract  length,  periods  15-20. 
(Truncated  model,  a=0.95) 


Time  Period 


15 

16 

17 

18 

19 

20 

2 

7.21 

6.87 

6.78 

6.92 

6.81 

141.39 

3 

9.61 

9.80 

9.65 

200.30 

4 

25.83 

24.63 

24.30 

24.78 

24.42 

506.65 

5 

7.52 

llPiii 

3.39 

3.46 

3.41|:' 

107.34 

6 

^iiiP 

IHp|i 

12.43 

12.68 

12i4|: , 

222.57 

Table  14. 


Enlistees  by  contract  length,  periods  15-20. 
(Dual  equilibrium  model,  a=0.95) 
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Time  Period 

Contract  Length 

18 

19 

2 

7.46 

7.05 

7.05 

7.05 

7.05 

7.05 

3 

10.09 

9.99 

9.99 

9.99 

9.99 

9.99 

4 

25.52 

25.28 

25.28 

25.28 

25.28 

25.28 

5 

3.56 

5.08 

5.08*: 

■ 

6 

12.72 

1L38 

rnMr 

iliilll 

m:38 

Table  15. 

Enlistees  by  contract  length,  periods  15-20. 
(Primal  equilibrium  model,  a=0.95) 


In  examining  the  truncated  model’s  results  (Tables  10  and  13),  it  is  clear  that  the 
end  effect  associated  with  the  selection  of  5  and  6  year  contracts  is  evident  for  both  a=0.5 
and  a=0.95.  When  the  dual  and  primal  equilibrium  results  are  examined  for  a=0.5  (Tables 
1 1  and  12),  the  choice  of  a  is  influencing  the  long  term  costs  which  influence  the  number 
of  5  versus  6  year  contracts.  However,  when  the  dual  and  primal  equilibrium  results  are  ex¬ 
amined  for  0=0.95,  the  relative  worth  of  a  6  year  contract  is  improved. 

Promotion  end  effects  are  eliminated  using  primal  and  dual  equilibrium  approxima¬ 
tion  methods  with  0=0.5.  Tables  16-18  provide  a  listing  of  the  number  of  E4’s  selected  for 
promotion  to  E5,  for  periods  15-20,  given  0=0.5,  for  the  truncated,  primal,  and  dual  equi¬ 
librium  approximations  .The  truncated  solution  still  has  a  significant  end-effect  at  the  20 
year  point.  Both  primal  and  dual  equilibrium  approximations  appear  to  take  into  account 
this  promotion  end  effect  even  with  o=0.5,  however,  the  numbers  selected  for  promotion 
are  significantly  lower  than  those  with  o=0.9.  (i.e.,  the  primal  equilibrium  approximation’s 
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Years  of  Service  I  I  Years  of  Service 


total  number  of  enlistees  at  period  20  is  down  23%,  and  dual  equilibrium  approximation’s 
total  number  of  enlistees  at  year  19  is  down  64%).  This  appears  to  be  the  result  of  too 
heavily  discounting  the  value  of  promotions. 


Time  Period 


15 

16 

17 

18 

19 

20 

3 

8.364 

6.109 

5.593 

19.904^),- 

4 

5.026 

4.569 

6.970 

4.142 

4.039 

14.7df^ 

5 

6.041 

4.142 

4.039 

14.375 

6 

1.160 

0.914 

1.394 

1.219 

1.136 

;4.05r  ^ 

7 

0.193 

0.152 

0.232 

0.159 

0.573 

8 

0.232 

0.159 

0.155 

Table  16. 


Promotions  by  years  of  service  to  E5. 
(Truncated  model  (a=0.5)) 


Time  Period 


15 

16 

17 

18 

19 

20 

3 

7.734 

liilil 

liilil 

5.701 

4,029 

29.967 

4 

li^f' 

4.637^-v 

6,908  : 

iPilil 

5 

5.98T 

44.18 

,;2.943'  \f 

20.158 

6 

1-382 

1.4§  " 

|U099 

4.652 

7 

1311 

0;230; 

EHb 

1.821 

8 

liii® 

o.p^* 

0.775 

Table  17. 


Promotions  by  years  of  service  to  E5. 
(Dual  equilibrium  model  (a=0.5)) 
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Table  18. 


Promotions  by  years  of  service  to  E-5. 


(Primal  equilibrium  model  (a=0.5)) 


For  TAPLIM,  decreasing  a  significantly  influences  the  optimal  solution  choices, 
however,  even  with  a  0.5  discount  factor,  both  primal  and  dual  equilibrium  approximations 
eliminate  significant  end  effects. 

For  the  zero  growth  model,  both  primal  and  dual  equilibrium  approximations  effec¬ 
tively  capture  end  effects  of  TAPLIM.  The  choice  of  a  should  reflect  the  relative  value  of 
future  decisions,  as  its  choice  can  heavily  influence  the  optimal  decision  variables.  For 
TAPLIM,  a  high  value  of  a  (0.9  or  higher)  seems  appropriate  for  primal  and  dual  equilib¬ 
rium  approximations. 

3.  Allowing  for  Growth  in  the  Right  Hand  Side  (p>0) 

Two  approaches  help  evaluate  end  effects  of  the  truncated  model  for  growth  of  the 
right  hand  side  (RHS)  after  period  9.  The  first  involves  initiating  a  constant  growth  rate 
(1+P)  of  1 .05,  starting  at  period  12,  and  continuing  on  indefinitely.  The  truncated  model  in 
this  case  should  experience  end  effects,  particularly  relating  to  the  manning  requirements 
for  higher  rates,  since  the  truncated  model  fails  to  account  for  future  growth.  In  this  case, 
the  dual  equilibrium  approximation  is  feasible  for  all  P<(l-a).  Unfortunately,  the  primal 
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equilibrium  approximation  is  not  feasible  over  any  reasonable  finite-horizon. 

The  truncated  formulation  is  run  over  a  19  year  horizon,  then  compared  with  the  19 
year  partial  objective  function  value  of  the  20  year  dual  equilibrium  approximation.  Table 
19  shows  a  large  gap  exists  between  the  optimal  objective  function  values  for  the  truncated 
and  dual  equilibrium  approximation. 


Truncated  Objective 

Partial  Objective, 
Dual  Equilibrium 

Difference 

945.10 

1076.94 

>13% 

Table  19. 


Comparison  of  truncated  objective  to  dual  equilibrium  partial  objective. 
(Growth  rate  of  5%  starting  at  year  12) 


A  closer  examination  of  the  output  of  both  models  reveals  that  both  the  truncated 
and  dual  equilibrium  formulations  over-man  in  to  cope  with  future  year  requirements,  with 
dual  equilibrium  having  significantly  higher  manning  levels.  Table  20  shows  E4  over-man¬ 
ning. 


Time 

Period 

Truncated 

Over-manning 

Dual  Equilibrium 
Over-manning 

6 

9.946 

11.029 

12 

0.0 

2.983 

17 

0.0 

4.853 

20 

0.0 

28.636 

Table  20. 

Overmanning  of  E4’s  to  satisfy  future  exponential  growth. 


The  dual  equilibrium  approximation  is  over-manning  to  overcome  future  period 
growth,  which  is  occurring  at  an  exponential  rate  over  the  infinite  horizon.  Using  exponen¬ 
tial  growth  over  the  infinite  horizon  to  determine  the  impact  of  growth  on  the  stability  of 
the  early  decision  variables  is  questionable,  since  in  reality,  increases  or  decreases  in  mili- 
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tary  manning  are  not  exponential  over  any  significant  time  horizon.This  method  was 
dropped  in  favor  of  a  more  realistic  growth. 

4.  Examining  the  Stability  of  Initial  Decision  Variables,  Given  Fu¬ 
ture  Period  Growth  (p>0)  Over  a  Finite  Horizon 

Truncated,  dual  equilibrium,  and  primal  equilibrium  approximations  are  run  using 

a  5%  growth  rate  from  periods  12  to  14.  Figure  22  illustrates  the  convergence  performance 
of  truncation,  and  primal  and  dual  equilibrium  approximations. 


Figure  22. 

Convergence  of  truncated,  primal  equilibrium,  and  dual  equilibrium  approximations. 
(a=0.9,  and  5%  annual  growth,  periods  12-14) 

The  solution  horizon  length  is  longer  because  invariance  is  not  established  until  pe¬ 
riod  15.  The  difference  between  the  primal  equilibrium  approximation  and  dual  equilibri¬ 
um  approximation  optimal  objective  function  values  is  less  than  0.05%  for  a  29  year 
solution  horizon.  The  truncated  solution  at  20  years  is  approximately  3%  below  the  infinite 
horizon  optimal  (between  544  and  545),  and  even  at  30  years,  has  an  approximate  1.3% 
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gap.  End  effects  influence  the  truncated  problem  over  solution  horizons  up  to  and  including 
30  periods. 

Examining  the  output  verifies  the  truncated  formulation  experiences  the  same  end 
effects  difficulties  with  the  accession  and  promotion  decisions  encountered  earlier.  The  pri¬ 
mal  and  dual  equilibrium  approximations  effectively  capture  these  end  effects. 

5.  Comparing  Optimal  Accession  Decision  Variables  (Zero 
Growth  Against  5%  Growth) 

Primal  and  dual  equilibrium  approximations  take  into  account  end  effects  missed 
by  the  truncated  model.  Therefore,  it  is  reasonable  to  use  primal  and  dual  equilibrium  ap¬ 
proximations  to  determine  optimal  accession  policies.  However,  this  approach  assumes 
that  the  coefficients  associated  with  future  periods  are  known.  How  stable  are  the  earlier 
period  decisions  regarding  accessions  when  future  period  requirements  are  uncertain?  This 
question  is  difficult  to  deal  with  directly.  However,  insight  is  gained  regarding  the  stability 
of  accession  decisions  by  examining  changes  between  the  zero  and  5%  growth  models.  Ta¬ 
bles  21-22  compare  the  dual  equilibrium  approximations.  Tables  23-24  compare  the  primal 
equilibrium  approximations. 
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1  Time  Period 

7 

8 

9 

10 

:S 

bO 

2 

6.03 

7.36 

6.95 

7.32 

G 

3 

10.43 

9.85 

10.36 

b 

4 

26.37 

24.92 

26.22 

G 

O 

U 

5 

A.ll 

5.88 

6.21 

7.77 

6 

9.31 

11.30 

10.01 

9.30 

Total 

50.26 

61.34 

57.94 

60.95 

Table  21. 


Number  of  enlistees  by  contract  type,  periods  7-10. 
(Dual  equilibrium,  30  period  solution  horizon,  no  growth) 


Time  Period 

7 

8 

9 

10 

’S 

bD 

7.13 

7.40 

7.79 

3 

10.10 

10.48 

11.04 

4 

25.55 

26.50 

27.92 

G 

O 

U 

5 

2.87 

5.54 

9.78 

10.89 

6 

10.53 

11.10 

7.48 

7.30 

Total 

47.85 

59.42 

61.64 

64.94 

Table  22. 

Number  of  enlistees  by  contract  type,  periods  7-10. 

(Dual  equilibrium,  30  period  solution  horizon,  5%  growth,  periods  12  - 14) 
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Time  Period 

7 

8 

9 

10 

5 

bJ) 

2 

6.03 

7.36 

6.95 

7.31 

C 

3 

8.54 

10.43 

9.85 

10.36 

t-i 

4 

21.61 

26.37 

24.92 

26.21 

o 

U 

5 

4.81 

5.86 

6.12 

7.61 

6 

9.27 

11.31 

10.11 

9.46 

Total 

50.26 

61.33 

57.95 

60.95 

Table  23. 


Number  of  enlistees  by  contract  type,  periods  7-10. 
(Primal  equilibrium,  30  period  solution  horizon,  no  growth) 


Time  Period 

7 

8 

9 

10 

-4-* 

bX) 

2 

5.74 

7.13 

7.38 

7.74 

C 

d) 

3 

8.12 

10.11 

10.45 

10.96 

4 

26.44 

27.72 

d 

o 

U 

5 

2.87 

5.54 

9.80 

10.85 

6 

10.51 

11.11 

7.41 

7.20 

Total 

47.79 

59.45 

61.48 

64.47 

Table  24. 

Number  of  enlistees  by  contract  type,  periods  7-10. 

(Primal  equilibrium,  30  period  solution  horizon,  5%  growth,  periods  12-14) 

Tables  21  -  24  highlight  the  following: 

•The  primal  and  dual  equilibrium  approximations  provide  optimal  solutions 
that  are  almost  identical  over  the  same  projected  future  manning  requirements 
(Table(s)  21/23,  Table(s)  22/24). 
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•There  is  some  difference  in  the  optimal  accession  choices  for  the  periods  7  - 
10,  when  comparing  the  optimal  zero  growth  choices,  with  the  optimal  5% 
growth  choices. 

The  impact  on  the  optimal  objective  function  value  of  using  zero  growth  optimal 
decisions  when  5%  growth  is  actually  encountered  in  periods  12  - 14,  is  measured  by  using 
the  zero-growth  optimal  decisions  for  periods  7-10,  as  input  data  to  the  growth  model,  then 
comparing  the  optimal  objective  value  to  that  of  the  original  growth  model.  Table  25  sum¬ 
marizes  the  results. 


Primal  Equilibrium 
Objective  Value 

Dual  Equilibrium 
Objective  Value 

Zero  Growth 

525.139 

524.977 

5%  Growth 

544.765 

544.466 

5%  Growth  Using  Zero 
Growth  Decisions 

552.710 

552.415 

%  Increase  in  5%  Growth 
Objective  When  Zero  Growth 
Decisions  Used 

1.5% 

1.5% 

Table  25. 


Quantifying  impact  of  using  zero  growth  decisions  for  5%  growth 


Key  results  include: 

•Zero  growth  decisions  from  the  primal  equilibrium  approximation  in  periods 
7-10  are  feasible  under  5%  growth  for  periods  12-14. 

•Zero  growth  decisions  from  the  dual  equilibrium  approximation  in  periods  7- 
10  are  feasible  under  5%  growth  for  periods  12-14. 

•Zero  growth  decisions,  are  sub-optimal,  but  lead  to  objective  values  that  lie 
within  1.4%  of  the  infinite  horizon  optimal  (which  lies  between  544.466  and 
544.765). 
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This  sample  point  of  a  potential  future  change  provides  insight  regarding  the  quality 
and  of  early  period  decisions.  In  this  case  the  decisions  made  assuming  zero  growth  in  pe¬ 
riods  7-10  are  near  optimal  for  the  5%  growth  model. 

6.  Comparing  Optimal  Accession  Decision  Variables  (Zero 
Growth  Against  10%  Growth,  Periods  11-20) 

This  section  examines  the  impact  of  10%  growth  over  periods  1 1-20  on  early  period 
(7-10)  manning  requirements.  Primal  and  dual  equilibrium  approximations  are  run  over  a 
30  year  horizon.  This  solution  horizon  provides  a  tight  bound  for  this  growth  pattern.  Table 
26  shows  a  comparison  of  the  optimal  objective  function  values. 


Primal  Equilibrium  Optimal 
Solution,  30  Period  Horizon, 
10%  Growth, 

Periods  11-20 

Dual  Equilibrium  Optimal  Solu¬ 
tion,  30  Period  Horizon, 

10%  Growth, 

Periods  11-20 

Gap  (%) 

12,715.038 

12,604.856 

0.9% 

Table  26. 

Determining  the  gap  between  primal  and  dual  equilibrium  approximations. 
(30  period  solution  horizon,  10%  growth  periods  11-20) 


Tables  27-28  provide  the  optimal  decision  accession  decision  variables  (periods  7- 
10)  given  10%  growth,  for  periods  1 1-20. 
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1  Time  Period 

7 

8 

9 

10 

W) 

2 

7.50 

8.33 

8.10 

c 

(D 

3 

11.47 

O 

cd 

4 

29.02 

26.81 

c 

o 

U 

5 

6.15 

7.23 

7.21 

9.52 

6 

11.36 

12.19 

11.68 

7.93 

Total 

62.52 

69.37 

67.48 

62.34 

Table  27. 


Number  of  enlistees  by  contract  type,  periods  7-10. 

(Dual  equilibrium,  30  period  solution  horizon,  10%  growth,  periods  11-20) 


Time  Period 

7 

8 

9 

10 

2 

7.62 

8.49 

7.92 

7.56 

c 

(D 

3 

10.79 

12.03 

11.22 

10.71 

4 

27.30 

30.43 

28.39 

27.08 

O 

U 

5 

6.98 

7.62 

7.23 

8.18 

6 

12.19 

Total 

63.49 

70.76 

Table  28. 


Number  of  enlistees  by  contract  type,  periods  7-10. 

(Primal  equilibrium,  30  period  solution  horizon,  10%  growth,  periods  11-20) 

Given  10%  annual  growth,  TAPLIM  requires  more  accessions  in  early  periods  than 
under  the  assumption  of  zero  growth  to  offset  future  period  manning  needs  for  the  higher 
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rates.  This  is  not  surprising  given  the  amount  of  growth.  Over  a  10  year  horizon,  billet  and 
manning  requirements  for  all  rates  increase  over  235%.  Since  the  model  can  only  satisfy 
higher  rate  manning  requirements  through  promotion,  the  model  hires  early  to  deal  with  fu¬ 
ture  higher  rate  (E7,  E8,  E9)  needs.  To  determine  the  penalty  incurred  by  implementing 
zero  growth  decisions  under  10%  growth  for  periods  1 1-20,  the  zero  growth  decisions  are 
forced  on  the  growth  rate  model.  Table  29  compares  the  optimal  objective  function  values 


for  the  growth  model,  (constrained  versus  unconstrained); 


Primal  Equilibrium 
Objective  Value 

Dual  Equilibrium 
Objective  Value 

Zero  Growth 

525.139 

524.977 

5%  Growth 

12715.037 

12604.856 

10%  Growth  Using  Zero 
Growth  Decisions 

13340.150 

13450.259 

%  Increase  in  10%  Growth 
Objective  When  Zero  Growth 
Decisions  Used 

4.9% 

6.7% 

Table  29. 

Quantifying  the  impact  of  using  zero  growth  decisions 
when  10%  growth  occurs  over  periods  11-20. 


Implementing  zero  growth  decisions  in  the  growth  model  still  leads  to  a  feasible  so¬ 
lution,  however  the  solution  is  sub-optimal.  A  difference  of  between  5-7%  in  the  infinite- 
horizon  optimal  (which  lies  between  12,715  and  12,605)  is  possible.  A  closer  examination 
of  the  decisions  also  shows  that  from  the  models  point  of  view,  implementing  zero  growth 
decisions  results  in  ramping  up  recruiting  to  unrealistic  levels,  overmanning  lower  rates  and 
undermanning  higher  rates  in  later  periods.  While  the  model  treats  these  conditions  as  fea¬ 
sible  (at  a  high  cost),  these  conditions  are  not  feasible  in  practice. 
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7.  Determining  Quantitative  Impact  of  Using  Zero  Growth  Initial 
Optimal  Decisions  When  Potential  For  Growth  Exists 

Assume  that  two  extreme  right  hand  side  possibilities  are  possible,  b^,  which  rep¬ 
resents  zero  growth  manning  requirements,  and  which  represents  some  reasonable  max¬ 
imal  growth  possibility  for  manning  needs.  Chapter  VII  derived  algorithm  which 

given  two  potential  right  hand  sides,  Bq  and^l,  generates  anon-increasing  sequence  of  up¬ 
per  bounds  on  the  deviation  of  the  optimal  infinite  horizon  solution  if  optimal  solutions  tied 
to  bQ,  are  used  for  any  6=(l-0)6o+(6)*l-  This  section  illustrates  the  utility  of  this  algorithm 

to  generate  an  upper  bound  on  the  deviation  of  the  optimal  objective  value  of  TAPLIM,  un¬ 
der  the  5%  growth  conditions  presented  previously  in  section  6.  Specifically,  Bq  represents 
the  establishment  of  post-downsizing  level  manning  requirements  from  year  7  onward,  bi 
represents  the  same  baseline  established  in  year  7,  but  then  initiation  of  a  5%  annual  growth 
rate  in  manning  requirements  between  years  12-14.  Manning  requirements  then  hold  level 
from  period  13  onward.  In  solving  hpr(Q),  the  ENLIST^  ^  variables  for  periods  7-10  are 
fixed  to  the  optimal  decision  variables  obtained  by  solving  primal  equilibrium  approxima¬ 
tion  using  level  future  manning  requirements  (i.e.,  right  hand  side  Bq). 

The  following  initial  information  is  known  (Obtained  from  Table  25.): 


•Zero  Growth  Optimal  (Dual  Equilibrium)  hd(0)  =  524.977 

•Zero  Growth  Optimal  (Primal  Equilibrium)  hp(0)  =  525.139 

•5%  Growth  Optimal  (Dual  Equilibrium)  hdil)  =  544.466 

•5 %  Growth  Optimal  (Primal  Equilibrium)  hp(l)  =  544.765 


•5  %  Growth  Optimal  (Primal  Equilibrium  Restricted)  hpr(  1 )  =  552.7 1 1 

In  examining  the  difference  hpr(iyhd(l)=S.245,  the  maximum  potential  error  gen¬ 
erated  by  using  the  initial  decision  variables  is  at  least  8.245,  (the  restricted  primal  deci¬ 
sions  are  used  and  the  infinite  optimal  solution  is  equal  to  the  dual  equilibrium 
approximation).  However,  the  maximum  error  can  potentially  be  worse.  Two  full  iterations 
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problem,  XQError  performs  quite  well. 


First  Approximation 
ofhpr(e) 


Second  Approximation 
ofhpr(Q) 


Upper  Bound 
on  Error  After 
Second  Iteration 


Upper  Bound  on 
Error  After  First 
Iteration 


Known  points  qfhd(Q) 
Known  points  ofhpr{B) 
Known  points  ofhp(Q) 


Figure  23. 

iting  the  performance  of  algorithm  on  TAPLIM. 


oeriences  end  effects  when  solved  using  truncation.  Two  key  dec 
enced  by  end  effects  are  the  number  of  accessions  selected  each  p 
id  the  number  of  personnel  selected  for  promotion  each  period  (b 


SiVS 


[Siti 


equilibrium  approximations  provide 


ity  to  capture,  and  quantify  the  impact  of  these  end  effects.  Primal  and  dual  equilibrium  ap¬ 
proximations  can  also  be  used  to  quantify  the  impact  of  using  baseline  infinite-horizon 
decisions,  when  manning  requirements  differ  from  the  infinite-horizon  baseline. 

Primal  and  dual  equilibrium  approximations  have  proven  useful,  effectively  elimi¬ 
nating  the  end  effects  associated  with  the  truncated  formulation  of  TAPLIM.  While  primal 
and  dual  equilibrium  approximations  worked  well  on  TAPLIM,  the  primal  equilibrium  ap¬ 
proximation  could  not  be  used  with  TAPLIM/FPS.  Given  the  quality  of  data  provided,  fur¬ 
ther  study  of  TAPLIM/FPS  was  not  pursued. 

The  next  chapter  examines  the  capability  of  the  primal  and  dual  equilibrium  ap¬ 
proximations  to  bound  the  infinite  optimal  solution  and  eliminate  end  effects  for  an  integer 
program. 
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VII.  APPLYING  PRIMAL  AND  DUAL  APPROXIMATION 

METHODS  TO  QUANTIFY  END  EFFECTS  FOR  AN  INTEGER 
PROGRAM 

This  chapter  examines  the  capability  of  primal  and  dual  equilibrium  apporoxima- 
tions  to  bound  the  infinite  optimal  objective  function  value  and  quantify  end  effects  for  an 
integer  program.  For  the  problem  considered,  the  methodology  proves  highly  successful  in 
both  bounding  the  infinite  optimal  solution  and  identifying  and  minimizing  the  impact  of 
end  effects.  Dual  and  primal  equilibrium  approximations,  solving  over  the  same  solution 
horizon  as  a  truncated  formulation,  provide  a  tight  bound  around  the  infinite  optimal  and 
eliminate  a  key  end  effect  which  adversely  influences  the  truncated  formulations  optimal 
decision  variables. 

Section  A  introduces  the  integer  program  of  interest,  called  Optimally  Scheduling 
Instructors  (OSI).  OSI  is  currently  in  use  by  the  Defense  Language  Institute  (DLI),  as  a  de¬ 
cision  aid  to  determine  instructor  requirements  and  establish  course  schedules.  Section  B 
presents  a  finite  period  formulation  of  OSI.  Section  C  then  expands  the  finite-horizon  for¬ 
mulation  to  an  infinite-horizon  formulation,  and  provides  insight  regarding  the  basic  matrix 
structures  involved.  Sections  D  and  E  derive  the  dual  and  primal  equilibrium  approxima¬ 
tions  for  the  infinite-horizon  formulation  of  section  C.  These  formulations  form  the  basis 
for  the  follow-on  analysis.  Section  F  examines  the  impact  of  end  effects  on  OSI  providing 
the  following  results; 

•The  first  period  optimal  decisions  are  highly  variable  for  varying  truncated 
solution  horizons. 

•The  optimal  initial  decisions  generated  by  shorter  truncated  solution  horizons 
are  suboptimal  over  longer  truncated  horizons. 
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•Primal  and  dual  equilibrium  approximations  tighdy  bound  the  infinite-hori¬ 
zon  optimal  solution  for  solution  horizons  as  little  as  3  years.  In  addition, 
both  the  primal  and  dual  equilibrium  initial  year  optimal  decisions  remain 
quite  stable  for  increasing  solution  horizons. 

•The  primal  equilibrium  approximation  tightly  bounds  the  infinite  optimal 
solution,  is  feasible  to  the  infinite-horizon  problem,  and  any  remaining  end 
effects  have  little  influence  over  the  optimal  objective  value,  since  any 
remaining  end  effects  can  only  influence  the  infinite  optimal  objective  over  a 
very  small  range. 

•The  end  effects  of  using  the  initial  year  optimal  decisions  from  the  three  year 
truncated  model  significantly  influence  the  optimal  solution  over  the  infinite- 
horizon.  The  primal  and  dual  equilibrium  approximations  eliminate  the  key 
end  effect  influencing  the  truncated  formulation. 

•The  choice  of  the  discount  factor  a  has  little  influence  over  the  optimal  deci¬ 
sions. 

•The  impact  of  future  growth  on  the  optimal  first  year  decisions  is  minimal. 

Finally,  section  G  summarizes  the  key  results  of  this  chapter.  For  OSI,  primal  and 
dual  equilibrium  approximations  prove  highly  effective  in  generating  realistic  solutions 
that  minimize  end  effects. 


A.  OPTIMALLY  SCHEDULING  INSTRUCTORS 

Optimally  Scheduling  Instructors  (OSI)  is  a  series  of  mixed  integer  programs  de¬ 
signed  for  the  Defense  Language  Institute  (DLI),  that  are  currently  used  to  assist  in  the  cre¬ 
ation  of  a  separate  yearly  course  schedule  for  each  foreign  language  (see  Dell,  Kunzman, 
and  Bulfin,  (1993)). 

Dell,  Kunzman,  and  Bulfin  report  the  constraints  imposed  by  DLI  in  generation  of 
a  schedule  to  include: 

•Instructors  work  full  time; 

•Instructors  are  hired  on  a  one  year  contract  (Calendar  Year); 

•Instructors  can  only  teach  one  section  of  a  course  at  a  time; 
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•Two  instructors  are  needed  for  each  section  of  a  course; 

•DLI  is  closed  for  holiday  during  the  last  two  weeks  in  December.  (This 
allows  the  use  of  a  yearly  50  week  schedule  for  modeling); 

•DLI  restricts  any  courses  from  beginning  within  one  month  prior  to  the 
December  Holiday.  Courses  may  be  allowed  to  end  during  this  period; 

•Courses  may  not  end  within  the  three  weeks  following  the  December  holiday 
break; 

•DLI  prefers  to  start  three  (but  no  more  than  three)  sections  of  a  course  in  any 
week;  and 

•The  scheduled  section  starts  must  satisfy  the  yearly  requirement  for  section 
starts. 

B.  MODEL  OSIi 

The  model  of  interest  is  OSIi,  the  first  model  in  the  series  (see  Dell,  Kunzman,  and 
Bulfin,  (1993))  which  seeks  to  minimize  the  total  instructor  man-years  over  the  solution  ho¬ 
rizon  while  satisfying  course  scheduling  requirements.  The  following  sections  provide  a 
detailed  formulation  for  OSIj. 

1.  Indices:  OSIj 

i  course; 

y  schedule  year  (i-^); 

t,t'  weeks  DLI  is  in  session  (i-50(^)). 


2.  Given  Data:  OSIx 

startif  1  if  course  i  can  begin  in  week  t  and  0  otherwise  (this  parameter 

enforces  scheduling  restrictions); 

pcdur^  number  of  sections  in  session  during  week  t  due  to  past  scheduling 

decisions; 
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section;,,  number  of  sections  of  course  i  that  require  scheduling  in  year  y, 

V 


lengthi 


length  of  course  i  (in  weeks). 


3.  Decision  Variables:  OSIi 


number  of  sections  of  course  i  to  start  in  week  t  (non-negative 
integer,  limited  to  a  value  ^); 

maximum  number  of  simultaneous  sections  meeting  in  year  y 
(with  Xjf  restricted  to  non-negative  integer,  tmaXy  is  implicitly  a 
non-negative  integer). 


4.  Formulation:  OSI] 

Objective: 

Minimize  ^2  x  tmaXy 


Subject  to  the  following  constraints: 


50y 

S 

t=  il  +  50{y-l)) 
\/i,y 


start^^Xff  =  sectwn^y 


X  E  star^^,x^^,+pcdur^<tmax 

•  t'  =  t-  lengthy  .  50  _ 

\/t,  L  J  is  the  floor  operator 

Constraint  (1)  ensures  that  yearly  requirements  for  course  i  are  scheduled.  Con¬ 
straint  (2)  defines  the  maximum  number  of  simultaneously  scheduled  courses. 


C.  EXPANDING  OSIi  OVER  AN  INFINITE  SOLUTION  HORIZON 

The  formulation  structure  for  OSIi  has  the  following  characteristics: 

•Feasible  weeks  that  a  given  course  is  eligible  to  start  remain  unchanged  from 
year  to  year;  and 
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•Course  requirements  from  year  to  year  are  relatively  stable.  Therefore,  the 
truncated  formulation  can  be  extended  to  an  infinite-horizon  formulation 
using  “steady  state”  yearly  requirements. 

Computational  experience  with  OSIj,  shows: 

•OSIi  routinely  provides  integer  solutions  with  very  small  integrality  gaps 
with  respect  to  the  LP  relaxation  (less  than  3%);  and 

•The  first  year  decision  variables  experience  significant  end  effects  as  the  trun¬ 
cated  solution  horizon  varies.  It  appears  end  effects  influence  the  initial  opti¬ 
mal  decisions  over  solution  horizons  from  3  to  6  years. 

Because  OSIj  is  influenced  by  end  effects,  and  the  constraint  structure  is  invariant 
and  staircase  in  nature,  OSIj  is  a  candidate  for  using  dual  and  primal  approximations  to 
quantify  potential  end  effects.  The  observed  small  integrality  gaps  associated  with  truncat¬ 
ed  solutions  indicate  the  LP  relaxation  to  the  dual  equilibrium  approximation  may  provide 
a  good  lower  bound. 

OSIj,  defined  over  an  infinite-horizon  (in  years),  exhibits  a  two  period  overlap 
staircase  matrix  structure.  The  two  period  overlap  is  a  result  of  the  fact  that  some  course 
lengths  are  in  excess  of  50  weeks.  Therefore  it  is  possible  for  one  of  these  courses  to  start 
a  section  in  year  y-2,  and  not  complete  the  section  until  the  first  part  of  year  y.  The  formu¬ 
lation  below  illustrates  this  two  period  overlapping  staircase  structure: 
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oo 


Minimize  cx 0X2  +  cx^  +  CLcx^ . . .  +  ct  cXj^  +  ^  a 

3 

cXy 

y=k  +  l 

Subject  to: 

Axj 

=-bj+s 

U) 

KXj  +Ax2 

+ 

II 

(2) 

HXj  +KX2 

=  b 

(3) 

Hx^_2  +KXj^-1 

=  b 

(k) 

Hx^_j  +Kx^+Axj^^j 

=  b 

(k+1) 

Xy>0  (y=0,l,2...)- 

For  OSIi,  the  objective  function  is  discounted  beginning  with  period  3.  This  en¬ 
sures  convergence  of  the  optimal  objective  function  value.  In  the  formulation,  Xy  is  the  vec¬ 
tor  (Xit:50(y-l)+l<t^0y,  tmaXy),  by  is  the  associated  right  hand  side  which  includes  yearly 
section  requirements  sectioniy,  and  s  and  d  represent  previously  scheduled  sections  which 
impact  on  the  first  two  year  totals.  Also  note  that  by  becomes  invariant  from  year  3  onward. 

D.  DUAL  EQUILIBRIUM  FORMULATION 

The  dual  equilibrium  approximation  aggregates  with  the  a  discount  factor  all  the 

OO 

constraints  from  period  k  onward  and  then  substitutes  =  X  resulting  re- 

y  =  k 

formulation  is: 
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{k-l)-3  k--3  . 

Minimize  cx  j -^0X2+ cx^-\- acx^...  +  cf^ 

Subject  to: 

Ax  I 

KXj  +AJC2 
HXj  +KX2 


=  bj-^s  (i) 

=  ^2+^  (2) 
=  ^  (3) 


^^k-4 

^^^k-2 

(k-2) 

^^k-3 

^AXk_i 

=  b 

(k-1) 

^^k-2 

(  2  ^ 

+  (K  +  aH)Xi^_j  +[A  +  ai:  +  a 

b 

1-a 

(k) 

X  >0. 

y 

The  dual  equilibrium  implementation  for  period  k  constraints  depends  on  the  row 
structure  of  H,K,A,  and  b.  The  structure  of  the  OSIi  allows  us  to  capture  the  appropriate 
H  and  K  elements  as  shown  in  the  dual  equilibrium  formulation  OSIid. 


1.  Indices:  OSIjd 

i  course; 

t,t'  weeks  DLI  is  in  session  (i  toT=  kx50); 

y  schedule  year  (1  to  k). 

2.  Given  Data:  OSIjd 

startle  1  if  course  i  can  begin  in  week  t  and  0  otherwise  (this  parameter 

enforces  scheduling  restrictions); 

pcduTf  number  of  sections  in  session  during  week  t  due  to  past  scheduling 

decisions; 

number  of  sections  of  course  i  that  require  scheduling  in  year  y, 
length  of  course  i  (in  weeks). 


sectiofiiy 


3.  Decision  Variables:  OSIid 


tmax^, 


number  of  sections  of  course  i  to  start  in  week  t^O(k); 

(non-negative  integer,  limited  to  a  value  <5); 

maximum  number  of  simultaneous  sections  meeting  in  year  y 


(when  restricted  to  non-negative  integer,  tmaXy  y<Y,  is  implicitly 
a  non-negative  integer). 

(Note:  Using  the  LP  relaxation  provides  a  valid  lower  bound  and  unless  specified 
otherwise,  this  is  the  bound  reported  for  the  dual  equilibrium  approximation.) 

4.  Formulation:  OSI^d 

Minimize 

fk-i  \ 

2xtmaxi  +  2xtmax2+  ^  tmaXy  +2a  {tmaxj^) 

V  =  ^  ' 

Subject  to: 


t=  U  +  50(y-l)) 
Vi,y<k 


section. 

_ V 


X  =  — 

t=  (l+50(y-l)) 

Vi,y=k 


^  ^  startf^,x.f,  +  pcdur^  <  tmax 

i  t'  -t- length- 

\/t<50(Y-l) 


(t-i)  . 
50 
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S  X  start.^.x.^,  +  pcdur^  + 

^  t'  -t- lengthy 

f  ^ 

{k-l)50 

a  ^  X  startit>x^  t>^50  + 

i  t'  =  max  (t  -  lengthy,  {k -2)  50  ■¥  1) 

^  if  max  {t  -  length.,  {k  -  2)  50  ■¥  1)  <  (k  - 1)  50  J 


{k-2)  50 

«  X  s 

i  f  =  max  {t  -  length.,  (k  -3)50  +  1) 

^  if  max  (t  -  length.,  {k  -3)50  +  1)  <  {k-  2)  50 


start^^\t>^ioo  + 


{k-2)50 

a  X  X  ^tmaxk 

^  f  =  max  {t  -  lengthy,  {k- 3)  50  +  1) 

^  if  max  (t  -  length.,  (k  -  3)  50  +  1)  <  (k  -  2)  50  J 

\/(50(k-lhl)<t<50k 


E.  PRIMAL  EQUILIBRIUM  FORMULATION:  OSIi? 

The  primal  equilibrium  formulation,  OSIjp,  uses  cuts  of  the  forma[ry.£,+7=A:y,  (all 
y^,  l<T<Jr)  For  example,  consider  k=20  years,  and  L=5.  This  implies  that: 
^16=^21=^26=^31-’ 

•*^17=-*^22=  ^27=  ^32—’ 

^  1 8='^23=  ^28=  -"^33  -  ’ 

■^19=^24=  ^29=  ^34’"’ 

•*^20=^25=  ^30=  ^35 — 

From  this  illustration  it  is  clear  that  primal  restrictions  start  being  included  with  the 
year  k-L+1  variables  (year  id  in  our  example).  This  method  of  defining  cuts  has  the  advan¬ 
tages  that  it  leads  to  a  relatively  simple  finite  period  re-formulation  of  the  infinite-horizon 
problem  as  shown  below: 
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y=k-L^l 


Subject  to: 


Ax 

=  bj  +s 

(1) 

KXj 

+Ax2 

(2) 

Hxj 

+Kx2 

+Axj 

(^) 

^^k-2 

+KXk_i 

+AXk 

^b 

(k) 

^^k-1 

.KXk 

+AXj 

k 

+  7- 

-L 

^b 

(k+1) 

HXk 

+KXj 

k 

+  7- 

-L 

{kf  k  +  2  —  L) 

=  b 

(k+2) 

X 

>0 

l>L 

y 


Fixing  a  value  of  k  also  allows  different  values  of  L  to  be  investigated,  without  al- 
tering  the  size  of  the  resulting  formulation.  This  allows  for  an  effective  comparison  of  dif¬ 
ferent  cut  structures,  as  the  resulting  formulations  have  the  same  number  of  variables  and 
constraints. 

For  OSIjp,  the  primal  equilibrium  implementation  for  period  k+1,  and  k+2  con¬ 
straints  depends  on  the  row  structure  of  H,  K,  A,  and  b.  The  structure  of  the  OSI^  allows  us 
to  capture  the  appropriate  H  and  K  elements  as  shown  in  the  primal  equilibrium  formula¬ 
tion  OSI|p. 

1.  Indices:  OSIjp 

i  course; 

t,t'  weeks  DLI  is  in  session  (7  toT=  kx50); 

y  schedule  year  (1  to  k). 

2.  Given  Data:  OSIjp 

startif  1  if  course  i  can  begin  in  week  t  and  0  otherwise  (this  parameter 

enforces  scheduling  restrictions); 
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pcduvt 


number  of  sections  in  session  during  week  t  due  to  past  scheduling 
decisions; 

section;^,  number  of  sections  of  course  i  that  require  scheduling  in  year  y, 
lengthi  length  of  course  i  (in  weeks). 

3.  Decision  Variables:  OSIjp 

x-j  number  of  sections  of  course  i  to  start  in  week  t^O(k-l) 

(non-negative  integer,  limited  to  a  value  <5); 
tmaxy  maximum  number  of  simultaneous  sections  meeting  in  year  y 

(with  Xjy  restricted  to  non-negative  integer,  tmaXy  y<^,  is  implicitly 
a  non-negative  integer.). 


S 

t  -  lengthy 


start  +  pcdur^  <  tmax 


\/t<50(k) 


(2) 
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{k-l)50 

i  t'  =  max  {t- lengthy,  {k- 2)  50  +  1) 
if  max  {t  -  lengthy,  {k-2)50  +  1)  <  {k- 1)50 
t 

*  =  max  {t- lengthy,  {k- 1)50  +  1)  (2pl) 

max  {t -lengthy,  {k- 1)50  +  1)  <  {k)50 

(k-2)50 

X  X  start. ^,x.^  t'  +  50-  -(L-i) 

^  t'  =  max  (t- lengthy,  {k-3)50  +  1) 
if  max  {t  -  lengthy,  (k-3)50  +  1)  <  (k-2)50 

\J(50(k-lhl)<t<50k 

{k-l)50 

*  t'  =  max  (t- lengthy,  {k-2)50  +  1) 

if  max  (t  -  length.,  (k  -  2)  50  +  i)  <  (k- 1)  50 

t 

X  X  ^^^^ht'^i,t'-max(50(L-2),0) 

^  f  =  max  {t- length.,  (k- 1)50  + 1)  (2p2) 

if  max  {t  -  length.,  {k  -  7)  50  +  7)  <  {k)  50 
{k-2)50 

X  X  +  100-^^^^k-max{L-2,0) 

i  f  =  max  {t -lengthy,  {k- 3)  50+1) 

if  max  (/  “  lengthy,  {k  -  5)  50  +  7)  <  (A:  -  2)  50 

V(50(k-l)+l)<t<50k 


F.  EXAMINING  THE  IMPACT  OF  END  EFFECTS  ON  OSIi 

This  section  examines  the  ability  of  dual  and  primal  equilibrium  approximations  to 
quantify  end  effects  for  OSIj  applied  to  Arabic  courses  taught  at  DLL  Arabic  was  chosen 
since  four  of  the  eight  yearly  courses  are  63  weeks  in  length  and  this  provides  a  fairly  large 
number  of  constraints  with  two  period  overlaps.  The  number  of  courses  required  increase 
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approximately  17%  between  years  1  and  2,  then  are  assumed  to  remain  unchanged  from 
year  three  onward  (see  Dell,  Kunzman,  and  Bulfin  (1993)  for  data). 

Section  1  examines  the  stability  of  the  initial  year  decisions  as  the  truncated  solution 
horizon  varies  between  3  and  6  years.  The  initial  year  decisions  vary  greatly,  indicating  end 
effects  influence  the  optimal  solution.  Section  2  examines  the  ability  of  primal  and  dual 
equilibrium  approximations  to  bound  the  infinite  optimal  solution  of  OSIi.  Primal  and  dual 
equilibrium  approximations  bound  the  infinite  optimal  solution  to  within  1%  over  solution 
horizons  as  short  as  three  years.  Section  3  quantifies  the  impact  of  using  initial  year  deci¬ 
sions  generated  by  the  truncated  formulation,  by  fixing  these  decisions  over  the  infinite-ho¬ 
rizon  and  examining  the  impact  on  the  primal  and  dual  equilibrium  approximations’ 
optimal  objective  function  values.  For  the  Arabic  data  set,  this  impact  is  significant.  Section 
4  examines  the  Optimal  decisions  generated  by  the  tmncated,  primal,  and  dual  equilibrium 
approximations,  and  identifies  a  key  end  effect  which  adversely  influences  the  optimal  de¬ 
cisions  of  the  truncated  model.  Section  5  analyzes  the  choice  of  a,  and  its  impact  on  the 
solutions  provided  by  primal  and  dual  equilibrium  approximations.  For  OSI^  with  Arabic 
data,  the  choice  of  a  has  little  impact  on  the  optimal  solutions.  Section  6  concludes  the  anal¬ 
ysis  by  examining  the  stability  of  the  initial  year  decisions  as  the  future  year  requirements 
vary.  The  initial  year  optimal  decisions  from  the  level  growth  model  are  always  near  opti¬ 
mal. 

1.  Stability  of  Initial  Year  Optimal  Decisions  as  the  Truncated 
Formulation  Solution  Horizon  Increases 

As  shown  in  Table  30,  initial  runs  with  the  Arabic  data  over  truncated  solution  ho¬ 
rizons  between  3  and  6  years  indicate  a  large  variation  in  the  optimal  first  year  solutions. 
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3  Year  Solution 
Horizon 

4  Year  Solution 
Horizon 

5  Year  Solution 
Horizon 

6  Year  Solution 
Horizon 

188  Instructors 

164  Instructors 

156  Instructors 

168  Instructors 

Table  30. 

Optimal  number  of  instructors  required  for  the  first  year  as  the 
solution  horizon  for  the  truncated  formulation  is  increased  from  3  to  6  years. 


There  is  a  large  variation  in  the  optimal  number  of  instructors  recommended  in  year 
one  as  the  truncated  solution  horizon  increases.  To  determine  if  the  first  year  solutions  (in¬ 
structors  required  and  proposed  course  schedule)  generated  by  the  shorter  solution  horizon 
formulations  are  suboptimal  over  longer  solution  horizons,  we  fix  the  first  year  solutions  in 
problems  with  longer  solution  horizons.  Table  31  provides  a  comparison  listing  of  the  op¬ 
timal  objective  function  values  for  the  truncated  formulation  obtained  using  first  year  con¬ 
strained  and  unconstrained  solutions. 


Unconstrained 

Objective 

Value 
(LP,  MIP) 

Constrained 
First  Period 
Optimal 
Instructor 
Schedule  from 

3  Year  Model 
(LP,MIP) 

Constrained 
First  Period 
Optimal 
Instructor 
Schedule  from 

4  Year  Model 
(LP,MIP) 

Constrained 

First  Period 
Optimal 
Instructor 
Schedule  from 

5  Year  Model 
(LP,MIP) 

4  Year  Solution 
Horizon 

713,714 

732,732 

- 

5  Year  Solution 
Horizon 

914,914 

944,944 

926,926 

- 

6  Year  Solution 
Horizon 

1111,1120 

1123.6,1124 

1120,1120 

1124,1124 

Table  31. 

Examining  optimality  of  first  year  optimal  decisions  when  these  decisions  are  applied 

over  longer  solution  horizons. 
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Fixing  the  first  year  best  integer  solution  derived  from  the  3  year  solution  horizon, 
for  the  4  to  6  year  solution  horizon  models,  adversely  impacts  the  best  integer  objective 
function  value  found  over  the  longer  solution  horizons  (increase  of  2.6%  for  4  year  horizon, 
3.3%  for  5  year  horizon,  and  0.5%  for  the  6  year  horizon).  Using  the  first  year  best  integer 
solutions  derived  from  the  4  year  solution  horizon,  leads  to  a  slightly  suboptimal  solution 
when  solved  over  a  5  year  horizon  (increase  of  1 .3  %),  and  no  significant  difference  is  noted 
for  the  6  year  solution  horizon  (the  linear  programming  relaxation  increases  by  1  %,  but  best 
integer  solution  has  the  same  objective  function  value).  Using  the  first  year  best  integer  so¬ 
lution,  derived  from  the  5  year  solution  horizon,  leads  again  to  slightly  sub-optimal  solu¬ 
tions  over  a  6  year  horizon  (optimal  objective  function  value  increases  1%). 

End  effects  influence  the  first  period  best  integer  solution  using  a  three  year  solu¬ 
tion  horizon.  These  end  effects  appear  to  be  present  in  some  form  even  over  4, 5,  and  6  year 
solution  horizons.  However,  this  method  of  evaluating  initial  year  solutions  for  end  effects, 
while  providing  qualitative  insight,  provides  no  guidance  in  determining  a  solution  horizon 
that  ensures  the  first  period  solution  is  in  some  sense  “nearly  optimal”. 

2.  Bounding  the  Infinite-Horizon  Optimal  Solution 

Assuming  that  the  course  requirements  from  year  3  onward  are  invariant  over  the 
infinite  horizon.  Table  32  reports  results  obtained  using  primal  and  dual  approximations 
with  lengths  of  3, 4, 5, 6, 10, 15,  and  20  years.  Specifically,  Table  32  provides  the  objective 
function  values  for  primal  and  dual  equilibrium  approximations  as  well  as  the  integer  solu¬ 
tion  for  the  number  of  instructors  required  for  years  3,4,5,  and  6.  Figure  24  provides  a 
graphic  comparison  of  the  optimal  objective  function  values  obtained  for  the  primal  equi¬ 
librium  approximation,  dual  equilibrium  approximation,  and  truncation,  as  the  solution  ho¬ 
rizon  varies  from  3-20  years.  For  all  horizon  lengths,  a=0.9  starting  with  year  4,  and 
X(=X(^j  for  primal  equilibrium.  The  primal  equilibrium  line  defines  a  near  optimal  objective 

value  (best  integer  solutions  with  integrality  gaps  of  1  to  2%  from  the  relaxed  optimal),  and 
therefore  provide  a  valid  upper  bound.  The  dual  equilibrium  values  represent  the  optimal 
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objective  value  obtained  by  the  LP  relaxation  to  the  dual  equilibrium  approximation,  and 
form  a  valid  lower  bound  on  the  infinite  optimal. 


Solution 

Horizon, 

Approxi¬ 

mation 

Type 

Relaxed 

Optimal 

Objec¬ 

tive 

Func¬ 

tion 

Value 

Best 

Integer 

Objec¬ 

tive 

Function 

Value 

Number  of  Instructors  (For  Each  Yr.) 

1 

Yr2 

Yr3 

Yr4 

Yr5 

Yr6 

188 

196 

4  Year 
Primal 

2290.2 

2308.0 

160 

196 

5  Year 
Primal 

2289.5 

162 

188 

200 

196 

6  Year 
Primal 

2289.36 

2299.8 

162 

188 

184 

198 

196 

196 

3  Year 
Dual 

2283.92 

2284.04 

158 

190 

- 

4  Year 
Dual 

2284.82 

2284.89 

164 

184 

184 

5  Year 
Dual 

2284.97 

2284.97 

164 

184 

184 

188 

- 

6  Year 
Dual 

2285.69 

2286.41 

164 

184 

184 

194 

202 

Table  32. 


Primal  and  dual  equilibrium  solutions. 
(3  to  6  year  solution  horizons) 
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Figure  24. 

Convergence  of  dual  and  primal  equilibrium  approximations. 

(a=0.9  discount  factor  starting  with  year  4) 

(Primal  Equilibrium  values  are  “Best  Integer”  near  optimal  solutions) 

Using  primal  and  dual  equilibrium  approximations,  the  infinite  optimal  solution  of 
the  mixed  integer  program  OSIi ,  given  that  year  3  requirements  hold  for  all  future  periods, 
lies  in  the  interval  (2286.24,  2292.31).  The  ability  of  primal  and  dual  equilibrium  approxi¬ 
mations  to  bound  the  infinite  optimal  objective  function  value  is  outstanding.  Even  with  a 
3  year  solution  horizon,  the  bound  generated,  (2283.922, 2308.0)  has  a  gap  of  just  1%.  Al¬ 
so,  unlike  the  truncated  formulation,  the  first  period  dual  and  primal  equilibrium  approxi¬ 
mations’  solutions  remain  relatively  stable  over  increasing  solution  horizons,  with  primal 
equilibrium  approximation  solutions  varying  between  160  and  162,  and  dual  equilibrium 
approximation  solutions  varying  between  158  and  164. 

3.  Quantifying  End  Effects  for  Initial  Decision  Variables 

The  bound  for  the  infinite-horizon  optimal  solution  lies  between  (2286.24, 

2292.3 1).  This  bound  provides  a  baseline  for  measuring  the  impact  on  the  infinite  optimal 
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solution  of  fixing  first  year  decisions  generated  by  the  three  period  truncated  formulation 
over  the  infinite-horizon  using  primal  and  dual  equilibrium  approximations.  Figure  25 
graphically  displays  the  results.  Primal  and  dual  solutions  are  generated  using  a  10  year  so¬ 
lution  horizon. 


Gap  Between  Bounds 
For  Infinite  Horizon 
Optimal  Objective 
Value 

2292.3  L  _ 

2286.24  _ 


Bound  on 
Horizon  Optimal  When  First 
Period  Decision  Unconstrained 


2317.19 


_  _2299.75 

on  Infinite 
Horizon  Optimal  When  First 
Period  Decision  Constrained 
To  Those  of  3  Period 
Truncated  Model 


Figure  25. 

Quantifying  the  impact  on  the  infinite  optimal  solution  when  the  first  year 
decisions  from  the  truncated  3  year  formulation  are  used. 

As  Figure  25  illustrates,  the  first  year  decisions  generated  by  the  3  year  truncated 
model  are  suboptimal  choices  over  the  infinite-horizon.  Figure  25  highlights  that  the  best 
possible  infinite-horizon  optimal  solution  implementing  first  year  decisions  is  2299.75, 
while  the  worst  possible  unrestricted  infinite-horizon  optimal  solution  is  2292.3 1 .  This  is  a 
minimal  gap  of  7.44.  While  this  gap  is  insignificant  compared  to  the  total  infinite-horizon 
cost,  «1%,  on  examining  the  year  to  year  manning  requirements,  most  of  this  cost  differ¬ 
ence  occurs  in  the  early  years  of  the  solution  horizon.  Table  33  provides  a  comparison  of 
cumulative  instructor  years  required  over  the  first  5  years,  for  the  primal  equilibrium  ap¬ 
proximation  (unconstrained)  and  the  primal  equilibrium  approximation  (constrained  to  use 
first  year  solution  from  the  truncated  formulation). 
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Year 

Year  1 

Year  2 

Year  3 

Year  4 

Year  5 

Constrained  Primal  Equilibrium 
Approximation  Using  First  Year  Solu¬ 
tion  From  3  Year  Truncated  Formulation 

188 

172 

184 

202 

200 

Unconstrained  Primal  Equilibrium 
Approximation 

160 

188 

188 

194 

200 

Cumulative  Difference  in  Total 

Instructor  Years 

-28 

-12 

-8 

-16 

-16 

Table  33. 


Illustrating  the  near  term  differences  in  manning  costs  when 
first  period  truncated  solutions  are  used  for  Arabic  course  schedule. 

It  is  evident  that  there  are  high  near  term  costs  associated  with  implementing  the 
first  period  decisions  provided  by  the  truncated  solution.  However,  since  all  costs  are  pos¬ 
itive  the  truncated  formulation  provides  a  best  possible  solution  minimizing  the  costs  over 
a  three  year  horizon.  The  question  is,  at  what  point  does  implementing  a  three  year  solution 
become  more  expensive  than  using  the  infinite-horizon  solution.  To  answer  this  question, 
a  year  by  year  comparison  is  made  using  the  primal  equilibrium  approximation.  Two  ten 
year  horizon  models  are  run,  one  restricting  the  first  three  year  decisions  to  those  provided 
by  the  three  year  truncated  formulation,  the  other  with  no  restrictions.  The  results  are  pre¬ 
sented  in  Table  34. 
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Year 

Year  1 

Year  2 

Year  3 

Year  4 

Year  5 

Constrained  Primal  Equilibrium 
Approximation  Using  Solutions  From  3 
Year  Truncated  Formulation 

188 

168 

166 

230 

214 

Unconstrained  Primal  Equilibrium 
Approximation 

160 

188 

188 

194 

200 

Cumulative  Difference  in  Total 

Instructor  Years 

-28 

-8 

+14 

-22 

-36 

Table  34. 

Illustrating  the  near  term  differences  in  manning  costs  when  solutions  from  a  three  year 
truncated  horizon  are  used  for  Arabic  course  schedule. 


As  expected,  the  truncated  model  provides  the  better  solution  for  a  three  year  hori¬ 
zon.  However,  the  year  4  requirements  are  quite  high,  and  over  a  4  year  horizon,  these  same 
choices  are  suboptimal.  The  truncated  model  does  not  have  to  anticipate  meeting  any  year 
4  requirements,  and  this  end  effect  is  adversely  influencing  the  optimal  decisions  for  the 
first  3  years. 

4.  Identifying  End  Effect(s)  Which  Influence  the  Initial  Decision 
Variables 

The  optimal  solutions  generated  by  the  truncated  formulation,  call  for  a  large  num¬ 
ber  of  instructors  in  year  1,  followed  by  a  significantly  smaller  number  of  instructors  in 
years  2  and  3.  This  is  a  non-intuitive  result,  since  the  course  loading  increases  from  year  1 
to  2,  and  then  remains  the  same  for  year  3.  Table  35  summarizes  the  course  requirements 
for  Arabic  and  the  optimal  number  of  instructors  generated  by  solving  the  truncated,  primal 
equilibrium,  and  dual  equilibrium  approximations. 
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Year 

YRl 

YR2 

YR3 

ARABIC  MODERN  STANDARD 
(63  Week  Course) 

65 

75 

75 

ARABIC  INTERMEDIATE 
(47  Week  Course) 

1 

1 

1 

ARABIC  ADVANCED 
(47  Week  Course) 

1 

1 

1 

ARABIC  REFRESHER 
(20  Week  Course) 

1 

1 

1 

Total  Courses  Required 

68 

78 

78 

Optimal  Number  of  Instructors 

Generated  by  Truncated  Model 

188 

168 

166 

Optimal  Number  of  Instructors  Generated 
by  Primal  Equilibrium  Approximation 
(10  year  solution  Horizon) 

160 

188 

188 

Optimal  Number  of  Instructors  Generated 
by  Dual  Equilibrium  Approximation 
( 1 0  Year  Solution  Horizon) 

162 

186 

188 

Table  35. 


Comparison  of  optimal  values  with  course  requirements  for  Arabic  data. 

Why  does  the  tmncated  solution  hire  so  many  instructors  in  year  1,  and  then  need 
so  few  instructors  in  years  2  and  3,  given  the  course  loading  is  increased?  The  minimum 
number  of  instructors  that  must  be  hired  in  years  2  and  3  is  twice  the  number  of  courses 
required,  since  2  instructors  are  needed  for  each  course.  For  year  1,  this  equates  to  136  in¬ 
structors,  for  years  2  and  3,  this  equates  to  156  instructors.  The  model  also  continues  to  sup¬ 
port  courses  that  are  ongoing  (courses  started  in  one  of  the  previous  two  years  prior  to  the 
current  solution  horizon).  A  closer  examination  of  the  results  indicates  that  the  truncated 
model  starts  as  many  courses  as  possible  near  the  beginning  year  one,  leading  to  significant 
overlapping  with  on-going  courses,  thereby  requiring  a  large  number  of  instructors  early  in 
the  year.  In  year  2,  the  model  seeks  to  start  as  many  courses  as  possible  in  the  middle  of  the 
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year,  minimizing  overlap  with  those  courses  which  began  in  the  beginning  of  year  1  (75  of 
the  78  courses  are  63  weeks  in  length).  For  the  third  year  the  model  starts  as  many  courses 
as  possible  during  the  last  third  of  the  year,  minimizing  overlap  with  year  2.  The  model  fails 
to  account  for  year  4.  Therefore  the  truncated  solution,  extended  to  year  4,  has  overlap 
problems  over  more  than  one  half  of  year  4’s  eligible  starting  weeks.  High  penalties  are 
paid  when  instructor  needs  are  minimized  over  a  3  year  horizon.  Both  primal  and  dual  equi¬ 
librium  approximations  effectively  account  for  this  end  effect.  The  solutions  generated  by 
the  four,  five,  and  six  year  truncated  formulations  all  exhibit  the  end  effect  of  scheduling 
as  many  courses  as  possible  late  in  the  final  period.  Solving  truncated  formulations  over  a 
longer  horizon  will  eventually  minimize  the  impact  of  this  type  of  end  effect  over  the  first 
period  optimal  solution.  The  advantage  of  using  primal  and  dual  equilibrium  approxima¬ 
tions  is  that  they  provide  a  tight  bound  on  the  infinite  optimal  solution  over  a  reasonable 
solution  horizon  (which  for  the  Arabic  data  is  as  few  as  3  years).  Any  remaining  end  effects 
can  only  influence  the  optimal  solution  over  the  range  of  the  bound.  For  OSI  using  the  giv¬ 
en  Arabic  data,  remaining  end  effects  can  only  minimally  influence  the  optimal  objective 
function  value  (<1%),  as  the  infinite  optimal  objective  function  value  is  bounded  between 
(2286.24, 2292.31).  The  primal  and  dual  equilibrium  approximations  capture  end  effect  in¬ 
fluences  in  reasonable  solution  horizons,  and  provide  a  basis  for  measuring  remaining  end 
effects. 


5.  INFLUENCE  of  a 

Solving  10  year  primal  and  dual  equilibrium  approximations  using  the  Arabic  data 
set,  for  a=0.5,  a=0.9,  and  a=0.95  provides  insight  regarding  the  influence  of  a  on  the  op¬ 
timal  decisions.  Table  36  displays  the  optimal  number  of  instructors  hired  for  each  year. 
The  size  of  the  gap  that  bounds  the  objective  function  value  remains  stable  over  a.  In  all 
cases,  the  bound  between  the  best  integer  primal  equilibrium  approximation,  and  the  linear 
relaxation  of  the  dual  equilibrium  approximation,  is  well  under  1%. 
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YEAR 

1 

2 

3 

!■ 

5 

6 

7 

8 

9 

10 

Dual  (a=0.5) 

166 

182 

180 

198 

205 

184 

200 

202 

380.4 

Primal  (a=0.5) 

166 

182 

180 

198 

204 

186 

196 

196 

Dual  (a=0.9) 

162 

186 

188 

194 

198 

198 

194 

1948.2 

Primal  (a=0.9) 

160 

188 

188 

194 

198 

196 

196 

Dual  (a=0.95) 

162 

186 

190 

190 

198 

200 

194 

194 

188 

3885.8 

Primal(a=0.95) 

164 

184 

188 

194 

198 

196 

196 

196 

194 

196 

Table  36. 

Comparison  of  the  optimal  number  of  instructors  required,  as  a  is  varied,  for  both 
primal  and  dual  equilibrium  approximations. 


Table  36  shows  no  distinguishing  trends.  Primal  first  year  decisions  vary  between 
166, 164,  and  160.  The  question  is,  how  stable  is  this  first  decision  with  respect  to  a?  Table 
37  compares  the  optimal  objective  function  values  from  solving  the  oc=0.5  and  a=0.95 
models  using  the  a=0.9  initial  year  decisions  (required  instructors  and  course  start  weeks). 
Using  a=0.9  initial  year  decisions  has  little  impact  on  the  optimal  objective  function  value 
for  a=0.5  or  a=0.95. 


Relaxed  Opti¬ 
mal  Objective 
Value 

Relaxed  Opti¬ 
mal  Using  a=0.9 
First  Year 
Decisions 

Best  Integer 
Objective  Value 

Best  Integer 
Objective  Value 
Using  (X=0.9 

First  Year 
Decisions 

a=0.95 

4229.71 

4229.9 

4258.44 

4261.54 

a=0.5 

726.47 

728.03 

726.69 

728.28 

Table  37. 

Comparison  of  objective  function  values  for  discount  rates  of  a=0.5  anda=0.95 
when  oc=0.9  first  year  decisions  are  used. 


For  OSIi  with  the  Arabic  data  set,  the  optimal  first  year  decisions  are  stable  over 


ot=0.5,  ot^=0.9,  and  a=0.95. 
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6.  Stability  of  the  Initial  Decisions  Over  Changing  Right  Hand  Side 
Values 

One  of  the  main  limitations  of  using  infinite-horizon  programming  techniques,  is 
that  implementation  assumes  that  the  right  hand  side  requirements  are  completely  specified 
over  the  infinite-horizon.  For  most  periodic  problem  structures,  the  right  hand  side  coeffi¬ 
cients  are  well  defined  for  only  a  few  periods.  The  question  of  interest  is,  how  stable  are  the 
initial  decisions  to  changing  future  requirements?  This  question  is  addressed  for  OSI  by: 

•  Solving  a  baseline  problem  using  both  primal  and  dual  equilibrium  approxi¬ 
mation  methods. 

•Solving  a  new  problem  using  both  primal  and  dual  equilibrium,  with  a  right 
hand  side  that  increases  course  start  requirements  for  years  4-6  over  the  base¬ 
line,  stabilizing  from  year  7  onward. 

•Restricting  the  initial  decisions  to  the  values  obtained  by  the  baseline  prob¬ 
lem  and  then  solving  the  primal  and  dual  equilibrium  approximations  using 
the  increased  course  start  requirements. 

•Comparing  the  optimal  decision  variables  and  objective  function  values  of 
the  restricted  growth  model  to  those  of  the  unrestricted  growth  model  (primal 
and  dual  equilibrium  approximations). 

Primal  and  dual  equilibrium  approximations  use  a  10  year  solution  horizon.  Feasi¬ 
bility  is  not  an  issue  since  any  feasible  set  of  first  year  decisions  remain  feasible  over  any 
solution  horizon.  Table  38  defines  the  course  requirements  for  the  baseline  and  growth 
models.  Table  39  provides  a  comparison  of  the  optimal  objective  function  values  and  deci¬ 
sion  variables.  The  initial  period  optimal  decisions  for  the  primal  and  dual  equilibrium  ap¬ 
proximations  baseline  models  are  near  optimal  for  the  growth  models. 
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Year 

Year  1 

Year  2 

Year  3 

Year  4 

Course 

Year  3  onward  invariant  for 
baseline  growth  model. 

Year  4  to  6  included  in 
growth  model  with  year  6 
onward  invariant. 

Arabic  Modern 
Standard  (63  Weeks) 

65 

75 

75 

80 

85 

90 

Arabic  Intermediate 
(47  Weeks) 

1 

1 

1 

2 

3 

4 

Arabic  Advanced 
(47  Weeks) 

1 

1 

1 

2 

3 

4 

Arabic  Refresher 
(20  Weeks) 

1 

1 

1 

2 

3 

4 

Total 

68 

78 

78 

86 

94 

102 

Table  38. 

Course  requirements  for  Arabic,  for  baseline  and  growth  models. 
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Model 

Objective 

Value 

(Relaxed) 

Best  Integer 

Objective 

Value 

Number  of 
Instructors 
Year  1 

Number  of 
Instructors 
Year  2 

Number  of 
Instructors 
Year  3 

Primal 

(Base) 

2287.12 

2301.6 

160 

188 

188 

Dual 

(Base) 

2286.06 

2289.57 

162 

186 

188 

Primal 

(Growth) 

2677.6 

2704.36 

164 

186 

190 

Primal 

(Growth) 

(Restricted) 

2677.77 

2683.38 

160 

188 

186 

Dual 

(Growth) 

2677.5 

2677.8 

162 

186 

186 

Dual 

(Growth) 

(Restricted) 

2766.7 

2677.9 

162 

186 

188 

Table  39. 

The  impact  of  restricting  the  growth  model  by  fixing 
the  initial  year  optimal  decisions  to  those  of  the  baseline  model. 


From  Table  39,  the  primal  restricted  solution  is  almost  identical  to  the  baseline  so¬ 
lution.  The  difference  between  the  unrestricted  and  restricted  growth  objective  function 
values  is  minimal,  and  the  best  integer  solution  derived  for  the  restricted  growth  model  is 
actually  better  than  that  generated  by  the  unrestricted  growth  model.  The  dual  equilibrium 
approximation’s  restricted  solution  is  identical  over  the  first  three  years  to  the  baseline 
model,  with  only  a  very  small  difference  noted  in  the  objective  function  values  between  the 
unrestricted  and  restricted  growth  models  (both  relaxed  and  best  integer  value).  The  first 
year  decisions  generated  by  the  zero  growth  model  are  clearly  nearly  optimal  over  the  ex¬ 
amined  growth  horizon.  While  no  direct  conclusions  can  be  stated  over  any  range  of 
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possible  right  hand  sides  between  these  two  extremes,  the  evidence  suggests  that  the  opti¬ 
mal  solution  generated  by  the  zero  growth  model,  should  remain  near  optimal  over  this 
range. 

G.  SUMMARY 

Using  the  model  OSI],  this  chapter  demonstrates  that  primal  and  dual  equilibrium 
approximations  (originally  developed  to  bound  infinite-horizon  linear  programs)  can  be 
used  for  integer  programs:  For  OSI}  primal  and  dual  equilibrium  approximations  both  min¬ 
imize  the  impact  of  potential  end  effects  and  effectively  bound  the  infinite-horizon  optimal. 
Primal  and  dual  equilibrium  approximations  generate  outstanding  bounds  on  the  infinite 
optimal  solution  for  OSIi.  Using  typical  truncated  formulation  solution  horizons  of  3  to  6 
years  produced  bounds  of  approximately  1  %  and  the  optimal  decision  variables  accounted 
for  a  key  end  effect  which  adversely  influences  the  solutions  of  the  truncated  formulation 
of  OSI.  While  more  general  cut  structures  of  the  formXt=A!:t+L  are  not  needed  to  produce 
tight  bounds,  these  cut  structures  are  still  valid,  and  should  be  considered  if  the  optimal  so¬ 
lution  appears  to  be  cyclic  in  nature.  For  OSIj ,  it  appears  that  x,  =  x,^,ast  grows  large, 
therefore  basic  primal  cuts  are  appropriate. 
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VIII.  CONCLUSIONS  AND  RECOMMENDED  RESEARCH 

The  focus  of  this  dissertation  is  quantifying  and  eliminating  end  effects.  If  a  trun¬ 
cated  problem  has  an  appropriate  infinite-horizon  extension  which  can  be  solved,  the  opti¬ 
mal  decision  variables  are  free  of  end  effects.  This  dissertation  develops  several  infinite- 
horizon  problem  structures  that  have  equivalent  finite-horizon  formulations.  These  prob¬ 
lems  are  easy  to  solve  and  their  optimal  decisions  are  free  of  the  end  effects  associated  with 
truncated  formulations. 

Unfortunately,  determining  whether  a  truncated  problem,  when  extended  to  an  in¬ 
finite-horizon,  has  a  finite-horizon  equivalent  formulation,  is  difficult.  Most  real-world 
problems  do  not  have  easily  definable  finite  period  equivalent  formulations.  This  provides 
motivation  for  using  primal  and  dual  equilibrium  approximations  to  provide  bounds  for  the 
infinite-horizon  problem. 

This  dissertation  shows  that  primal  and  dual  equilibrium  approximations  bound  the 
optimal  objective  function  value  for  any  LP®®  or  MIPoo.  Using  primal  and  dual  equilibrium 
approximations  to  bound  the  infinite-horizon  optimal  solution  of  the  primal  formulation  is 
effective  in  eliminating  end  effects  and  generating  near  optimal  solutions  for  both  TAPLIM 
and  OSIi.  The  methodology  appears  to  be  robust,  applicable  to  a  large  class  of  LP«>  and 
MIP«>  (a  potential  difficulty  lies  in  identifying  effective  primal  restrictions).  The  bounding 
method  is  easily  implemented  with  solution  times  comparable  to  those  of  the  original  trun¬ 
cated  formulations. 

This  dissertation  illustrates  that  convergence  of  truncated  and  dual  equilibrium  ap¬ 
proximations  to  an  infinite-horizon  optimal,  and  the  ability  to  practically  implement  the  pri¬ 
mal  and  dual  equilibrium  approximations,  does  not  depend  on  strong  or  weak  duality 
holding  in  the  limit. 
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For  LPo°,  this  dissertation  develops  and  implements  a  simple  algorithm  that  exam¬ 
ines  the  impact  of  a  changing  right  hand  side  on  a  fixed  set  of  initial  decision  variables.  This 
algorithm  is  easily  implemented  on  TAPLIM,  and  proves  effective  in  quantifying  the  im¬ 
pact  of  using  initial  decisions  over  a  convex  combination  of  potential  right  hand  sides. 

In  analyzing  the  results  of  this  dissertation,  several  interesting  questions  present 

themselves,  and  should  be  explored  further: 

•Primal  and  dual  equilibrium  approximations  prove  effective  in  eliminating 
end  effects  of  truncated  formulations,  however,  there  may  be  adverse  end 
effects  introduced  into  the  formulation  that  are  related  to  the  approximation 
methods  themselves.  The  quantitative  impact  of  any  remaining  end  effects 
can  be  determined  by  the  size  of  the  gap  between  the  primal  and  dual  equilib¬ 
rium  approximation.  A  gap  which  closes  slowly  as  the  solution  horizon 
increases,  may  be  due  in  large  part  to  end  effects  created  by  the  primal/and  or 
dual  equilibrium  approximation.  Chapter  IV  provides  an  example  where  a 
poor  choice  of  restriction  led  to  a  primal  equilibrium  approximation  which 
never  converged  to  the  optimal  solution.  This  is  clearly  an  end  effect. 

•Primal  restrictions  are  problem  specific  and  are  currently  limited,  as  the 
restriction  must  generate  a  non-empty  feasible  region,  and,  result  in  a  finite 
period  equivalent  re-formulation  of  the  original  infinite  horizon  problem.  At 
present,  simple  functional  ties  are  the  only  types  of  restrictions  identified 
which  satisfy  the  requisite  conditions  required  to  make  primal  equilibrium 
approximation  work.  Additional  research  is  needed  to  develop  alternative 
restrictions  that  generate  finite  period  re-formulations. 

•The  performance  of  primal  and  dual  equilibrium  approximations  when 
applied  to  mixed  integer  programs  should  be  investigated  further.  OSI  was 
chosen  to  test  primal  and  dual  equilibrium  methods  as  truncated  versions  of 
OSI  consistently  solved  with  small  integrality  gaps,  and  the  truncated  formu¬ 
lation  was  heavily  influenced  by  end  effects.  How  well  primal  and  dual  equi¬ 
librium  performs  may  be  closely  related  to  the  size  of  the  integrality  gap  for  a 
given  mixed  integer  program.  This  issue  should  be  explored  further  to  deter¬ 
mine  the  robustness  of  primal  and  dual  equilibrium  to  isolate  and  quantify  end 
effects  associated  with  truncated  mixed  integer  programs. 
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•The  issues  surrounding  uncertainty  in  the  infinite  horizon  coefficients  need  to 
be  explored  further.  The  analysis  performed  in  this  dissertation  on  the  initial 
decision  variables  examines  only  a  convex  combination  of  two  potential  right 
hand  side  extremes.  Better  methods  must  be  developed  to  analyze  the  impact 
of  uncertainty  on  the  optimal  decision  variables.  Uncertainty  in  future  period 
coefficients  can  be  viewed  as  an  end  effect. 
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